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Abstract. We develop an algebraic version of Cartan method of equivalence or an analog of 
Tanaka prolongation for the (extrinsic) geometry of curves of flags of a vector space W with 
respect to the action of a subgroup G of the GL{W). Under some natural assumptions on the 
subgroup G and on the flags, one can pass from the filtered objects to the corresponding graded 
objects and describe the construction of canonical bundles of moving frames for these curves in 
the language of pure Linear Algebra. The scope of applicability of the theory includes geometry 
of natural classes of curves of flags with respect to reductive linear groups or their parabolic 
subgroups. As simplest examples, this includes the projective and afhne geometry of curves. The 
case of classical groups is considered in more detail. 



1. Introduction 

Fix a vector space W over a field K, where IC = R or C. Also, fix integers = ko < ki < k2 < 
... <k^ = dim W and let {W) be the manifold of all flags = Aq C A_i C A_2 C . . . C 

A_^ = W , where A_j are /cj-dimensional linear subspaces. For definiteness we also assume that 
/ci > and A;^j-i < A;^. We allow equalities among ki, i.e. repeated subspaces in flags, because 
direct sums of flags will play an important role in the sequel. 

Now fix a Lie subgroup G of GL{W). The group GL{W) acts naturally on -Ffc^^...^fc^_j (H^). 
Assume that O is an orbit in Fk^^,,,^km(^) with respect to the action of G. The general question 
is whether given two unparamerized curves in O there exists an element of G sending one curve to 
another. Such two curves are said to be G -equivalent. We are also interested in the same question 
for parametrized curves of flags. 

Note that particular examples of this setup include the classical projective and affine geometries 
of curves in P" and and the projective geometry of ruled surfaces. In all these cases the action 
of the group G is transitive on the corresponding flag varieties. Other examples we will consider 
in this paper include: 

(1) G = GL{W) and O is the whole flag variety; 

(2) G = Sp{W), if W is equipped with a symplectic form a, G = 0{W), if W is equipped 
with a non-degenerate symmetric form Q, and O is the isotropic/coisotropic flag variety. 

Our original motivation to study such equivalence problems comes from the new approach, 
so-called symplectification procedure, to the geometry of structures of nonholonomic nature on 
manifolds such as vector distributions, sub-Riemannian structure etc. This approach was proposed 
in [H 121 El 13] and it is based on the Optimal Control Theory. It consists of the reduction of 
the equivalence problem for such nonholonomic geometric structures to the (extrinsic) differential 
geometry of curves in Lagrangian Grassmannians and, more generally, of curves of flags of isotropic 
and coisotropic subspaces in a linear symplectic space with respect to the action of the Linear 
Symplectic Group (i.e. a particular case of item (2) above). The symplectification procedure was 
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applied to the equivalence problem of vector distributions of rank 2 and 3 ( [131 El US] ) ■ For rank 
2 distributions curves of flags appearing in this approach are curves of complete flags consisting of 
all osculating subspaces of the curve of one-dimensional subspaces of these flags, i.e. one arrives 
to the classical Wilczynski theory of nondegenerate curves in projective spaces [37]. However, the 
geometry of curves of isotropic/coisotropic flags appearing in the symplectification procedure for 
rank 3 distributions is more involved and needed the development of a new technique. In [15] we 
treated such curves by a brute force method that cannot be extended to the curves appearing in 
the theory of distributions of higher rank. The theory developed here gives a conceptual way to 
work with all such curves. 

A general procedure for the equivalence problems under consideration was developed already 
by E. Cartan with his method of moving frames (see [8] and modern expositions, for example, by 
P. Griffiths [241 > M. Green [23], and M. Pels and P. Giver [18], [IS]). In the present paper we 
distinguish curves of flags for which the construction of canonical bundle of moving frames with 
respect to the action of a given group G can be done in purely algebraic way and describe this 
construction in the language of pure Linear algebra. 

For a different type of equivalence problems such as equivalence of filtered structures on man- 
ifolds an algebraic version of Cartan's equivalence method was developed by N. Tanaka in [35j . 
Instead of doing concrete normalizations, Tanaka describes the prolongation procedure for all 
possible normalizations in purely algebraic terms via so-called universal algebraic prolongation of 
the symbol of the filtered structure. 

We develop a similar algebraic theory for unparametrized curves of flags, satisfying some natural 
assumptions. The constructions and the results of the paper can be almost verbatim generalized 
to embedded submanifolds of flag varieties (see subsection 14. 6|) . It is worth to notice that an 
analog of Tanaka theory for curves (and submanifolds) in projective spaces and more general flag 
varieties was already developed in works of Y. Se-ashi [331 134j . interpreting geometrically and 
generalizing the classical work of Wilczynski [37| (see also |10j). However, Se-ashi treated much 
more restrictive class of equivalence problems compared to our present paper: first, he considers 
the case G = GL{W) only and second, he assumes that the algebraic prolongation of the symbol 
of the curve is semi-simple. The last assumption allows him to associate to a curve of flags (and, 
more generally, to a submanifold in a flag variety) a Gartan connection with values in the algebraic 
prolongation of the symbol by analogy with |36j . 

For the theory of curves (and, more generally, submanifolds) of flags our paper can be related to 
Se-ashi works |33i l34j in the same way as Tanaka paper ^35j about filtered structures on manifolds 
with general constant symbol is related to his later work [36] about filtered structures with symbol 
having semisimple universal algebraic prolongation. 

For unparametrized curves in Lagrangian Grassmannians first nontrivial invariants were con- 
structed in the earlier works of the second author with A. Agrachev [3l [5], using the notion of 
cross-ration of four points in Lagrangian Grassmannians. Our constructions here give a way to 
construct a complete system of invariants for curves of fiags in much more general situation. 

The present paper is closely related to our recent preprint [16j on geometry of curves in parabolic 
homogeneous space and, more generally, in a homogeneous spaces of a Lie group with a Lie algebra 
endowed with the fixed grading. The link between these papers is given in Remark 13.11 In jl6j 
we work with abstract groups while in the present paper we work with their representations. We 
had to develop here a special language which is more adapted to the case of representations and 
to the forthcoming applications to the geometry of distributions. 

The corresponding modification of the theory in the case of parametrized curves is given as 
well (see subsection 14. 5|) . This modification give more conceptual point of view on constructions 
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of papers [40 ^ \^T\ H2] on parametrized curves in Lagrangian Grassmannians and extend them and 
results of [31 m [2H1 [23 [301 Ell 132] to more general classes of curves. 

Let us briefly describe the main constructions and the structure of the present paper. As in 
the Tanaka theory for filtered structures on manifolds, the main idea of our approach is to pass 
from the filtered objects to the corresponding graded objects. In order to make it work we need 
additional assumptions on the group G and on the chosen orbit O C -Ffci,...A;,„ with respect to 
the action of G. This assumptions are discussed in section [2] (see Assumption 1 there) . Shortly 
speaking, any flag /o € O induces the filtration on the Lie algebra g of the Lie group G. And 
the compatibility of O with respect to the grading means that g is isomorphic (as a filtered Lie 
algebra) to the associated graded Lie algebra gr^^ g so that passing to the graded objects we do not 
change the group in the equivalence problem. Note that gr^^^ g can be identified with a subalgebra 
of sKg^/o where gij^ W is the graded space corresponding to the flag (the filtration) /q. We 
give an explicit algorithm for constructing of all orbits compatible with respect to the grading 
under the assumption that G is semisimple (see Proposition 12.11 for the irreducible case) and apply 
it when G is a symplectic or orthogonal subgroups of GL(W) (see Proposition 12.21 and Remark 
12. 1[ respectively). 

The curves of flags under consideration are also not arbitrary but they are compatible with 
respect to differentiation (see Assumption 2 in section [3]). Informally speaking, it means that 
the tangent line to a curve r i— )• A(r) C O at the point A(i) is a degree —1 element of the 
graded space gr^(j) g C sKS'^/o "^^^ condition of compatibility with respect to differentiation 
is natural through the refinement (osculation) procedure on curves of flags described in section 
[6l For example, starting with a curve in Grassmannian, it is natural to produce the curve of 
flags compatible with respect to differentiation by taking iteratively the osculation subspaces of 
the original curve. Then the equivalence problem for curves in Grassmannian is reduced to the 
geometry of curves in certain flag manifold which are compatible with respect to differentiation. In 
particular, in this way geometry of so-called non-degenerate curves in projective space is reduced 
to geometry of curves of complete flags compatible with respect to differentiation. 

Further, in section[3l similarly to Tanaka theory, we define the symbol of a curve r i— )• A(r) C O 
at a point with respect to the group G. For this first we identify the space gr^j-^) W with a fixed 
"model" graded space V such that this identification conjugate the group G with the fix subgroup 
G of GL(y). Then the tangent line to the curve r i-^ A(r) at the point A(t) can be identified 
with a line of degree —1 endomorphism in the Lie algebra g of the Lie group Q. Let Qo be the the 
subgroup of Q preserving the grading on V. Taking all possible identifications of gr^(() W with 
V as above we assign to the tangent line to the curve r i— t- A(r) at A(i) the orbit of a degree —1 
endomorphism from g with respect to the adjoint action of Gq. This orbit is called the symbol of 
the curve r i— > A(t) C O at A(t) with respect to the group G. 

The symbol of the curve of flags at a point is the basic invariant of the curve at this point. 
The main goal of the present paper is to study the equivalence problem (w.r.t. to the group G) 
for curves of flags with a given constant symbol. Note that the condition of constancy of symbol 
is often not restrictive. For example, this is the case, when G is semismple (or, more generally, 
reductive). It turns out that in this case the set of all possible symbols (for given group G) is 
finite. Therefore, the symbol of a curve of flags with respect to a semisimple (reductive) group G 
is constant in a neighborhood of a generic point. 

The way to solve the equivalence problem under consideration is to associate canonically the 
bundle of moving frames to any curve of flags . The main result of the paper (Theorem 14. ip 
shows that in the case of curves with constant symbol the construction of such canonical bundle of 
moving frames can be done in purely algebraic way, namely in terms of so-called universal algebraic 
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prolongation of the symbol. The universal algebraic prolongation of the symbol or, more precisely, 
of the line of degree —1 endomorphisms, representing the symbol, is the largest graded subalgebra 
of g such that its component corresponding to the negative degrees coincides with this chosen line 
of degree —1 endomorphisms. It is isomorphic to the algebra of infinitesimal symmetries of the 
so-called flat curve, which is the simplest (the most symmetric) curve among all curves with 
this symbol. In the proof of the main theorem, given in section 5, we first fix the normalization 
condition by choosing a complementary subspace to the image of certain coboundary operator in 
the space of certain 1-cochains. The construction of the bundle of canonical moving frames for 
any curve with given constant symbol is imitated by the construction of such bundle for the flat 
curve with this symbol. 

It is important to emphasize that the number of prolongation steps and the dimension of the 
resulting bundle of moving frame is independent of the choice of the normalization condition 
but it depends on the symbol only: the number of prolongations steps is equal to the maximal 
degree in the grading of the universal algebraic prolongation of the symbol and the dimension 
of the bundle of moving frame is equal to the dimension of the universal algebraic prolongation 
of the symbol. The computation of the universal algebraic prolongation is an iterative process, 
where on each step one needs to solve a system of linear equations. Hence even without fixing the 
normalization condition and starting the construction of canonical moving frames one can predict 
the main features of this construction using linear algebra only. 

Consequently, in order to apply our theory for equivalence of curves of flags with respect to 
the given group G it is important to classify all possible symbols with respect to this group and 
to calculate their universal algebraic prolongation. We implement these two tasks in sections [7] 
and El respectively, for the standard representation of classical groups. The universal algebraic 
prolongation in this cases can be effectively describe using the theory of s[2-representations. 

Our results in the case of Symplectic Group are crucial for application of so-called symplectifi- 
cation procedure to geometry of vector distributions: they give much more conceptual view on our 
constructions in [15] for rank 3 distributions and will be used in our future work on distributions of 
arbitrary rank. Therefore the symplectic case is treated in detail. The case of Orthogonal Group 
is very similar to the case of Symplectic Group. Hence we will only sketch this case referring to 
the corresponding objects in the symplectic case. 

Note that the set of all possible symbols of curves of flags with respect to a group G depends 
only on the group G as an abstract Lie group and it does not depend on a particular representation 
of G. Therefore the classification of the symbols in section [7] and the calculation of section [8] can 
be used for any representation of the classical groups. 

In general the bundles of moving frames obtained in Theorem 14.11 do not have a structure of 
a principle bundle. They belong to a wider class of bundles that we call quasi-principal bundles 
(see Definition 14. 2p . Quasi-principle bundles have some features of the principle bundles when one 
passes to the grading. The question whether one can choose normalization conditions such that 
the resulting bundle will be a principle one is reduced to the question whether this normalization 
condition, as a complementary subspace to the image of certain coboundary operator in the 
space of certain 1-cochains, is invariant with respect to the natural action of the subgroup of the 
group of symmetries of the flat curve preserving a point. In general, such invariant normalization 
condition may not exist. Some conditions for existence of the invariant normalization conditions 
and examples of symbols for which they do not exist are given in our recent preprint [16j . 

Finally, it is important to stress that we construct canonical bundles of moving frames for 
curves of flags with a given symbol in a unified way, i.e. without any branching in contrast to our 
previous construction for curves of isotropic/coisotropic subspaces of a linear symplectic space 
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appearing in the symplectification procedure for rank 3 distributions ([E]) and also in contrast 
to the Fels-Olver approach [181 [19]. The latter was used by G. Mari Beffa (see, for example, [281 
[29l [30l [3T] ) for geometry of parametrized curves with very particular symbols in Grassmannians 
of half-dimensional subspaces with respect to classical groups (of Lagrangian subspaces in the 
symplectic case and of isotropic half-dimensional subspaces in the orthogonal/conformal case). 
In the terminology of section [6] the first osculating space of such curves at any point is equal to 
the ambient vector space W. The main difference of those works from the treatment of the same 
curves in the present paper is that in those works not all curves with a given symbol but generic 
curves are considered. For example, the flat curves do not satisfy the genericity assumptions 
there. 

Acknowledgements We are very grateful to professor Pierre Deligne. The idea of treating the 
equivalence problem for curves of flags by passing to the graded objects stemmed from the way 
of presentation of the previous paper [41] of the second author with C.Li, which was proposed by 
professor Deligne during his edition of that paper. Also we would like to thank Professors Tohru 
Morimoto and Yoshinori Machida for very stimulating discussions. 

2. Compatibility of the pair {G,0) with respect to grading 

First let us recall some basic notions on filtered and graded vector spaces. A point 

/o = {0 = Ao C A_i C A_2 C . . . C A_^ = W} 

of O is a decreasing filtration of W. So, it induces the decreasing filtration {(g[(M^))jQ j}jg2 of 
dl{W), 

(2.1) {QKW))f,A = {Ae Ql{W) : A{Aj) C A,+, for ah j}, {Ql{W))f,^i C (5[(l^))/o,.-i 

It also induces the filtration on any subspace of bI(H^). Further, let gvj^ W be the graded space 
corresponding to the filtration /q, 

and let gr^^ 0f(W^) be the graded space corresponding to the filtration ()2.ip . 

gIf.gKW) = ^{gl(W))f,,/{Qi{W))f,,+i. 

The space gr^^^ 0l(W^) can be naturally identified with the space Qi{gic f^^W). Indeed, if Ai 
and A2 from (0t(M^))/o,j belong to the same coset of (0t(VF))/o,i/(0K^))/o,j+i' i-^- A2 — A\ G 
(0[(iy)) /o,j+i5 and if w\ and wi from Aj belong to the same coset of A^/Aj+i, i.e. W2 — w\ G Aj+i, 
then ^i^i and A^wi belong to the same coset of Aj+j/Aj+j+i. This defines a linear map from 
gr^ij 0l(VF) to 0[(grjg W). It is easy to see that this linear map is an isomorphism. 

Now let g C 0l(M^) be the Lie algebra of the group G. The filtration /o induces the filtration 
{5/o,i}iez on 5, where 

<?/o,i = (0W)/o,in5- 

Let grj^ g be the graded space corresponding to this filtration. Note that the space gfo,i/gfo,i+i 
is naturally embedded into the space (0[(T^))/Q^j/(0[(l^))/Qi+i. Therefore, gr^^ g is naturally 
embedded into gvj^ 0^^) and, by above, gr^^j g can be considered as a subspace of gl[gvj^^ W). 
It is easy to see that it is a subalgebra of 0[(grjg W). 

In general, the algebra gr^^ g is not isomorphic to the algebra g. 
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Example 2.1. Assume that dim TV = 4m, W is equipped with a symplectic (i.e. nondegenerate 
skew-symmetric) form a, Sp{W) is the subgroup of GL{W) preserving the form a, and sp(VF) is 
the corresponding Lie algebra. Assume that 

/o = {0 = Ao C A_i c A_2 = W}, 

where dimA_i = 2ni and the restriction of a to A_i is nondegenerate. Let us prove that 
gr^ij 5p(VF) is not isomorphic to sp(M^) (for more general case see Proposition 12.21 below) . For this 
first identify the space W/A-i with the skew-symmetic complement of A_i with respect to 
the form a. Using this identification, we have that W/A-i is equipped with the symplectic form, 
which the restriction of a to A^^. Besides A_i is equipped with the symplectic form, which is the 
restriction of a to it. Consider the following natural decomposition 

(2.2) 0[(A_i e W/A^i) = 0[(A_i) e 0[(VF/A_i) e Hom(A_i, 1^/A_i) Hom(P7/A_i, A_i). 

Then by direct computations one can show that the algebra gr^^^ sp(VF) is isomorphic to the 
subalgebra of 0l(A__i © W/A^i) consisting of endomorphisms A such that if A is decomposed as 
A = An + A22 + Ayi + Ai\ with respect to ([2^2]) then Ax\ G sp(A_i), A21 € sp(PF/A_i), and 
A21 = 0, where sp(A_i) and 5p(VF/A_i) are symplectic algebras of A_i and VF/A_i, respectively. 
Consequently, the algebra gr^^^ 5p(VF) is not semisimple and is not isomorphic to sp(l^). More 
general class of examples is given by Proposition l2.2l below. On the contrary, if A_i is a Lagrangian 
subspace, then similar argument shows that grj^sp{W) is isomorphic to 5p(VF). □ 

In order that the passage to the graded objects will not change the group in the equivalence 
problem we have to impose that gr^^^ g and g are conjugated for some (and therefore any) /o G 5. 
More precisely we will assume in the sequel the following 

Assumption 1 (compatibility with respect to the grading) For some /o € O , /o = {0 = Aq C 
A_i C A_2 C . . . C A_^ = W}, there exists an isomorphism J : gr j^W W such that 

(1) J(Ai/Ai+i) cAi,-n<i< -1; 

(2) J conjugates the Lie algebras gij-^ g and g i.e. 

(2.3) g = {J o X o J-'^ : X e gTj^ g}. 

Note that from the transitivity of the action of G on O it follows that if Assumption 1 holds 
for some fo & O then it holds for any other fo £ O. If Assumption 1 holds we say that the 
pair (G, O) is compatible with respect to the grading. Besides, the Lie algebra g has a grading via 
formula ()2.3p and this grading is defined up to a conjugation. 

Obviously, if G = GL(W) or SL{W), then G acts transitively on any flag variety _i(^) 
the pair (G, Ffcj^...^fc^_j (VF)) is compatible with respect to the grading. In general in order to 
construct a pair (G, O) compatible with respect to the grading, one can start with the fixed Z- 
grading on the Lie algebra g, g = gi, and try to find a flag /o in W such that the algebra 

grjg g is conjugated to g and the grading is preserved. Then as O one takes the orbit of /o with 
respect to G. In this case we say that the orbit O is compatible with respect to the grading of g. 

In the case of semisimple g there is an explicit algorithm for constructing all orbits of flags 
compatible with respect to the grading of g. Recall that an element e of a graded Lie algebra 
g = gi is called a grading element if ade{x) = ix for any x £ Qi. Since the map S : g ^ g 
iez 

sending x € to ix is a derivation of g and any derivation of a semisimple Lie algebra is inner. 
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for any graded semisimple Lie algebra there exist the unique grading element e. Moreover, this 
element is also semisimple as an endomorphism of W. 

Proposition 2.1. IfG C GL(W) is a semisimple Lie group acting irreducihly on W and a grading 
is fixed on its Lie algebra g, then there exists a unique orbit of flags compatible with respect to the 
grading of g. 

Proof. Assume that A is the highest weight of the ^-module W and v is the corresponding lowest 
weight. Using the basic representation theory of semisimple Lie algebras, one can easily get that 
in the considered case the spectrum spec(e) of the grading element e satisfies 

(2.4) spec(e) = {A(e) - i : i G Z, < « < A(e) - v{e)} 

(note that A(e) — v{e) is natural). Therefore the natural order on the spectrum of e is defined. 
-1 

Let W = Wj be the decomposition of W by the eigenspaces of e such that Wj is the 

j=u{e)-\(e)-l 

eigenspace corresponding to the eigenvalue A(e) + j + 1. Take the flag 

(2.5) /o = {W^n7i,(e)_A(e)-i such that W^ = 0Ty,. 

li X ^ gi and w G Wj, then e{w) = (A(e) + j + l)w and [e, 2;](?i;) = iw. Therefore 

(2.6) e o x{w) = [e, x\{w) + x o e{w) = (A(e) + {j + i) + l)x{w), 

i.e. x{w) G Wj+i. This implies that the map J : gr^^^ 1^ — )• W, which sends an element of 
y/i to its representative in Wj, conjugates gr^^j g and g. Therefore the orbit O/p of /o with 
respect to G is compatible with respect to the grading of g. 

Now let us briefly sketch the proof of uniqueness, which is based on the irreducibility assump- 
tion. Since the grading element e belongs to gQ, an orbit compatible with respect to the grading 
of g must contain a flag such that each subspace Wj is an invariant subspace of e. 

First one proves that W~^ C W~^. Assuming the converse, it is not hard to show that the space 
g.W~^ is a proper subspace of W, because it does not contain the nonempty set W~^\W~^ . This 
contradicts the irreducibility assumption. Further, if W~^ is a proper subspace of W~^, then in 
a similar way one can prove that the space g.W~^ does not contain the nonempty set 
which again contradicts the irreducibility assumption. Hence, W~^ = W~^. In the same manner 
one can prove that W^ = W^ for any — /i<j<— 2. □ 

Note that Proposition 12.11 is also true if G is reductive. The proof is the same. The only 
difference is that the grading element is not unique: it is defined modulo the center of g, but it 
does not effect the proof. 

We are especially interested in the case, when W is an even dimensional vector spaces equipped 
with a symplectic form a and G = Sp(W) or GSp{W), where Sp{W) is the corresponding 
symplectic group and CSp{W) is the so-called conformal symplectic group, i.e. the group of all 
transformation preserving the symplectic form cr up to a multiplication by a nonzero constant. 
Denote by sp(VF) and c5p{W) the corresponding Lie algrebras. Recall that a subspace L oi W 
is called isotropic with respect to the symplectic form a if the restriction of the form o" on L is 
identically equal to zero or, equivalently, L is contained in its skew-symmetric complement L^ 
(with respect to a), while a subspace L of is called coisotropic with respect to the symplectic 
form fj if L contains L^. 
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Definition 2.1. We say that a flag /o = {0 = Aq C A_i C A_2 C . . . C A_^ = W} in W is 
symplectic if (A„j)'^ = Aj_^ for any < i < fi. 

Obviously, the flag /o is symplectic, if and only if the following three conditions hold: any 
subspace in the flag /o is either isotropic or coisotropic with respect to the symplectic form a; 
a subspace belongs to the flag /o together with its skew-symmetric complement; the number 
of appearances of a subspace in the flag /o is equal to the number of appearances of its skew- 
symmetric complement in /q. 

Proposition 2.2. An orbit O in a flag manifold is compatible with respect to some grading on 
g = 5p(W) or c5p(W) if and only if some (and therefore any) flag f^^Ois symplectic. 

Proof. Let A be the highest weight of the considered standard representation of sp(l^) Fix the 
grading on g and let e be the grading element. Since csp(T^) = sp(Vl^)©IK, in the case g = csp(T^) 
we can always choose e € sp(VF). By above O is the orbit of the flag /o defined (|2.5|) . Since 
e G sp(M^), we have that a{ewi,W2) + cr{wi, ew2) = for any wi and W2 in W. This implies that 
if wi G Wj-^, W2 G Wj^, and A(e) + ji + 1 ^ — (A(e) -|- j2 + 1) then cj(u;i,'u;2) = 0, where Wj is 
the eigenspace of e corresponding to the eigenvalue A(e) + j + 1. From this and the fact that the 
form cr is nondegenerate it follows that the spectrum of e is symmetric with respect to (for more 
general statement see Remark 12.21 below) and a defines nondegenerate pairing between Wj-^ and 
Wj^ with A(e) -|- 1 = — (A(e) + j2 + 1). Consequently, the subspaces with A(e) -|- j -|- 1 > 
are isotropic and W^'' = {W^^y for A(e) + ji + I = -(A(e) + j2 + 1). Thus, the flag /o is 
symplectic. □ 

Remark 2.1. Assume that is a vector space equipped with a nondegenerate symmetric form 
Q, and G = 0{W) or CO(W), the orthogonal or conformal groups. The notion of isotropic and 
coisotropic subspaces of W with respect to the form Q are defined similar to the symplectic case, 
using orthogonal complements instead of skew-symmetric ones. Then by complete analogy with 
Proposition 12.21 the orbits of fiags compatible with some grading of g = 50 (W^) or c5o{W) consist 
of flags /o = {0 = Ao C A_i C A_2 C . . . C A_^ = W} such that (A_i)-^ = Aj_^ for any 
< i < /i , where L"*" denotes the orthogonal complement of L with respect to Q. We will call 
such flags orthogonal. A flag /o is orthogonal if and only if the following tree conditions hold: any 
Ai is either isotropic or coisotropic subspaces with respect to Q; a subspace belongs to the flag /o 
together with its orthogonal complement with respect to the form Q; the number of appearances 
of a subspace in the fiag /o is equal to the number of appearances of its orthogonal complement 
in /q. In particular, if IC = M and the form Q is sign definite then there is no orbits of flags 
compatible with the grading except the trivial one C VF. □ 

In the case of a general (not necessarily irreducible) representation of a semisimple (a reductive) 
Lie group G, the fiags compatible with the grading can be constructed by the following algorithm: 

(1) take fiags as in Proposition 2.1 in each irreducible component; 

(2) shift degrees of subspace in each of these fiags by arbitrary nonpositive numbers with the 
only restriction that for at least one irreducible component there is no shift of degrees, i.e. 
the minimal nontrivial subspace in the fiag sitting in this component has degree —1. 

Consider a flag which is a direct sum of the flags constructed in each irreducible component 
(with shifted degrees as above): the degree i subspace of this flag is equal to the direct sum of 
degree i subspaces of fiags in each irreducible component. Obviously, the orbits of such flags are 
compatible with respect to some grading of g. Moreover, they are the only orbits satisfying this 
property. The above restriction on the shifts of degrees was done in order that the resulting flag 
will satisfy our convention that the minimal nontrivial subspace in it has degree —1. 



On geometry of curves of flags of constant type 



9 



Remark 2.2. Note that the spectrum of the grading element is symmetric with respect to 
for any representation of the following simple Lie algebras Ai, Bi, Ci, Di for even i, Ef, Eg, 
F4, and G2 (in the proof Proposition 12.21 it was shown for the standard representation of the 
symplectic Lie algebras Ci only). It follows from the fact that among all simple Lie algebras 
these are the only algebras for which the map —1 belongs to the Weyl group of their root system 
(see, for example. [251 p. 71, Exercise 5]). Thus the highest and the lowest weights A and of any 
irreducible representation of these algebras satisfy ly = —A, which togehter with formula ()2.4p 
implies the desired statement about the spectrum of the grading element. □ 

As an example of non-reductive group G consider the case of an affine subgroup Aff(Vl^) of 
GL(W) which consists of all elements of GL(W) that preserve a fixed affine hyperplane A of W. 
Obviously, the restriction of an element of Aff (H^) to the affine space A is an affine transformation 
of A. We define an affine flag in an affine space ^ as a set {Ai}~^_^ of nested affine subspaces 
of A, Ai C Ai-i- An affine flag is called complete if it consist affine subspaces of all possible 
dimensions. A flag {Aj}r3_^ in W with A_i nA^^ defines the affine flag {Ai n A}:[}_^ in A. 
So, the equivalence problem for curves of flags with respect to the affine group Aff(VF) can be 
reformulated as the equivalence problem for curves of affine flags with respect to the group of 
affine transformations of A. As a particular case we have the classical equivalence problem for 
curves in an affine space. In order to use our theory for non-degenerate curves in an affine space 
A, i.e. curves which do not lie in any proper affine subspace of A, one has ffist to make the 
refinement (osculation) procedure of section [H] below to reduce the original equivalence problem 
to the equivalence problem of curves of complete affine flags. Finally, it is not hard to show that 
for any orbit O of flags with respect to Aff(VF) the pair (Aff (T^), O) is compatible with respect 
to the grading. 

Remark 2.3. The treatment of the reductive case suggests a way for construction of orbits 
compatible with respect to the grading in the case of arbitrary (not necessary reductive) graded 
subalgebra g C 0[(VF). Assume that a grading element e exists and also that e, as an endomor- 
phism of W, is semisimple. Now assume that the spectrum of e is a disjoint union of the sets 
{Aj}j^i such that if A belongs to Aj and A + z is an eigenvalue of e then A + i G ^j+j. As a 
grading of W take the splitting such that the j subspace of this splitting is the the sum of the 
eigenspaces of elements of Aj and as a flag /o take the corresponding flag as in ()2.5p . Then by 
the same arguments as in the proof of Proposition 12.11 we get that the orbit of /o is compatible 
with respect to the grading of g. 

3. Compatibility with respect to differentiation and symbols of curves of flags 

After clarifying what kind of orbits in flag varieties will be considered, let us clarify what kind 
of curves in these orbits will be studied. Let 

(3.1) t ^ {0 = Ao(t) C A_i(t) c A_2(t) C . . . C A_^(t) = W} 

be a smooth curve in O parametrized somehow. 

Recall that for a given parametrization of the curve ([XB the velocity f^Ai{t) at t of the curve 
r 1-^ Aj(r) can be naturally identified with an element of Hom(Aj(t), iy/Aj(t)) . Namely, given 
/ € Aj(t) take a smooth curve of vector £(r) satisfying the following two properties: 

(1) m = I, 

(2) £(r) G Aj(r) for any r closed to t. 

Note that the coset of £'{t) in W/Ai{t) is independent of the choice of the curve i satisfying the 
properties (1) and (2) above. Then to ^Aj(t) we assign the element of Rom{Ai{t),W/Ai{t)) 
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which sends / E Aj(t) to the coset of £'{t) in W/Ai(t), where the curve £ satisfies properties (1) 
and (2) above. It defines a hnear map from the tangent space at Aj(t) to the Grassmannian of 
fc_j-dimensional subspace of W to the space Hom(Aj(t), W/Ai{t)) . Simple counting of dimensions 
shows that this map is an isomorphism and therefore it defines the required identification. 

Assumption 2 (compatibility with respect to differentiation) We assume that for some (and 
therefore any) parametrization of the curve the velocity ^Aj(t) satisfies 

^Ai{t) £ Hom(Ai(t), Ai_i(t)/Ai(t)), V-/i + 1 < i < -1 and t. 



In this case we say that the curve ()3.ip is compatible with respect to differentiation. Equivalently, 
a curve (|3.ip is compatible with respect to differentiation if for every i, —fi + l<i<— 1, if i{t) 
is a smooth curve of vectors such that £{t) G Aj(t) for any t, then i'{t) £ Aj_i(t) for any t. 
The condition of compatibility with respect to differentiation is natural through the refinement 
procedure on curves of fiags described in section [U] below. 

Under Assumption 2, ^Aj(t) factors through a map 6t from Aj(t)/Aj-|_i(t) to Aj_i(t)/Aj(t). In 
other words, the map 6t G g[(gr^(j-) TV) of degree —1 is well defined up to a multiplication by 
a nonzero constant (recall that the reparametrization is allowed). Besides, since the curve (|3.ip 
belongs to the orbit of G then 

(3.2) <5tG (gr^(,) 

Now we define symbols of curves of flags at a point with respect to the group G. For this we 

start with some notations. Fix fo £ O such that /o = {0 = Aq C A_i C A_2 C . . . C A_^ = W} 

-1 

and denote V = grj^^ W, Vi = Aj/Aj+i. The grading V = Vi defines also the natural filtration 

-1 

(3.3) c c c ... c F"'' = F, y* = 0yj -/i<i<-i. 

Further, fix an isomorphism J '.V ^ W, satisfying conditions of Assumption 1. Let Q be the 

subgroup of GL(V) such that G = { J^^ o A o J : A £ G} and g is its Lie algebra. Further, let 

-1 

gl{V)k be the space of endomorphisms of V of degree k, Ql{V)k = Ilom.{Vi, Vi^k), and 

i=—li 

(3.4) 0fc = 0n0[(F)fe. 

By Assumption 1 this defines the grading of the Lie algebra 0: = ^^0fc- We define a 

_ _ kez 

"big" bundle P over the orbit O with the fiber P\ over a point A = {Aj}^_^ consisting of all 
isomorphisms A : V ^ W such that 

(1) A preserves the filtrations ([3^3]) and A = {Ai}i}_^, i.e. AiV'') = Aj(t) for any -/U + 1 < 
i < -1; 

(2) A conjugates the Lie groups Q and G i.e. G = {Ao X o A^^ : X € Q}; . 

(3) AoJ-^ £ G. 
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Further, let be the subgroup of G consisting of all elements of G preserving the filtration 
p.3p . Obviously, the corresponding subalgebra 0+ satisfies 0_|_ = ^^0fc, where as in p.4p . 

fc>0 

It is easy to see that the bundle P is a principle ^+-bundle over the orbit O. 

Remark 3.1. (Homogeneous spaces formulation) Note that P can be identified with G via the 
map A Ao J^^ and with G via the map A A~^J, A £ P. Besides, under the latter identi- 
fication O = G/G+ and the fibers of P are exactly the left cosets of G+ in G- The homogeneous 
space O = G /G+ is equipped with the natural ^-invariant vector distribution D which is equal at 
the "origin" oiG /G+ (i.e. at the coset of identity of ^/^-|-) to the equivalent classes of elements of 
degree — 1 of g under the identification of the tangent space to ^/ G+ at the "origin" with 0/0+ . 
Then a curve in O is compatible with respect to differentiation if and only if it is an integral curve 
of the distribution D. So, the equivalence problem for curves of flags compatible with respect to 
differentiation can be reformulated as the equivalence problem for integral curves of the natural 
G -invariant distribution in the homogeneous space G/G+- This point of view, restricted to the 
parabolic homogeneous spaces, is considered in our recent preprint [16J □ 

Further, the group G+ acts naturally on 0_i as follows: A £ G+ sends x G 0_i to the degree —1 
component of (Ad^) x. It induces the action on the projectivization P0_i in the obvious way. By 
constructions, the set Tit = o St o A^ : A £ -fA(t)}) where [A^^ o St o A^ denotes the 

degree —1 component of A~^ o 6t o A is an orbit in P0_i with respect to aforementioned action of 
G+- This orbit is called the symbol of the curve ()3.ip at the point {Ai{t)}^J!'_^ with respect to G. 

Remark 3.2. Note that by definition the set of all possible symbols of curves of flags with respect 
to a group G depends only on the group G as an abstract Lie group. In other words, it does not 
depend on a particular embedding of G to GL(W) for some W or, equivalently, on a particular 
representation of G. □ 

In the sequel we will consider curves of flags with the constant symbol 9Jt, i.e. Tit = Tl for 
any t. We also say that such curves of flags are of constant type 97t. If G (and therefore G) is 
semisimple and Go is the connected subgroup of G with subalgebra 0o, then due to E.B. Vinberg 
[38j the set of orbits with respect to the adjoint action of Go on Pg_i is finite. Note that if e is 
the grading element of and Go is the stabilizer of e with respect to the adjoint action of G, then 
the orbits of 0_i with respect to the natural action of G+ and the adjoint action of Go coincide. 
Besides Go is just the connected component of the identity in Go- Therefore in the case when G 
is semisimple the set of all possible symbols is finite and the condition of constancy of the symbol 
holds in a neighborhood of a generic point of a curve. The same conclusions can be done if G is 
reductive. 

Any curve of flags that is G-equivalent to the curve t {J o e*''y*}j=o,-i...,-/x for some 6 such 
that KS € 9K is called the flat curve with constant symbol Tl (here Vo = 0). The flat curve is an 
essence the simplest curve among all curves with a given symbol. 

Remark 3.3. If the group G coincides with its normalizer in GL{W), then for all constructions 
above it is not necessary to fix a map J : V W and the condition (3) in the definition of the 
bundle P can be omitted. 

Example 3.1. Assume that dim VF = n + 1 and consider a curve of complete flags 

t^{OC A-i{t) c A^2(t) C . A_(„+i)(t) = W}, 
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compatible with respect to differentiation. A complete flag means that dimA_j = i. Assume also 
that for any — n < i < — 1 the velocity ^Aj(t) , as an element of Hom(Aj(t), Aj_i(t)/Aj(t)), is 
onto Aj_i(t)/Aj(t). The symbol of such curve of complete flags (with respect to GL{W)) is a line 
of degree —1 endomorphisms of the corresponding graded spaces, generated by an endomorphism 
which has the matrix equal to a Jordan nilpotent block in some basis. The flat curve of the 
maximal refinement is the curve of osculating subspaces of a rational normal curve in the projective 
space FW. Recall that a rational normal curve in FW is a curve represented as t i-^ [1 : t : : 
. . . t"] in some homogeneous coordinates. □ 

As in the Tanaka theory for filtered structures on manifolds, we want to investigate the original 
equivalence problem via the passage to the graded objects, that is to imitate the construction 
of the bundle of canonical moving frames for any curve with a given constant symbol 9Jt via 
the construction of such bundle for the flat curve with symbol 9Jt. The latter can be done in 
purely algebraic way via the notion of the universal algebraic prolongation of the symbol which 
is introduced in the next section. 

4. Algebraic prolongation of the symbol and the main result 

From now on we consider a curve of flags ()3.ip with constant symbol 9Jt and we fix a line m in 
0_i representing the orbit 9Jt. Often the line m itself will be called the symbol of the curve ()3.ip 
as well and we will shortly say that the curve l\'6.1\) has constant symbol m instead of constant 
symbol with the representative m. 

4.1. Algebraic prolongation of symbol. Set u_i = m and define by induction in k 
(4.1) Ufc := {X G gfc : [X, 6] € Uk-i, 6 em}, k>0. 

The space is called the kth algebraic prolongation of the line m. Then by construction u(m) = 
Ufc is a graded subalgebra of q. It can be shown that it is the largest graded subalgebra of 

k>-l 

g such that its component corresponding to the negative degrees coincides with m. The algebra 
u(m) is called the universal algebraic prolongation of the line xn (of the symbol W). Obviously, 
0[(^)a: = for ah k > fi. So Ufc = for A; > fi. 

The algebra u(m) has a very natural geometric meaning. Namely, let T be the curve t i-^ 
{e*'^y*}j=o,-i,...,-^ in the corresponding flag manifold -Ffci,...,fc^_i (V^) for some (5 G m. The group 
GL{V) acts naturally on this flag manifold, and thus, we can identify each element X G 0l(l^) 
with a vector field on i*fci,...,A:^_i (T^). We define a symmetry algebra of F as a set of all elements 
X € Q, such that the corresponding vector field on -Ffci,...,fc^_i (1^) is tangent to F. 

As it is shown in [11], the symmetry algebra of F is the largest subalgebra of q that contains m 
and lies inm + X]i>o S«- from ()4.ip that u satisfies this property by construction. 

Thus, we see that u(m) is exactly a symmetry algebra of the curve F. Besides, a flat curve with 
symbol m is G-equivalent to the curve J(F). Therefore the algebra u(m) is conjugated to the 
symmetry algebra of a fiat curve with the constant symbol m. 

4.2. Zero degree normalization. Let -P|a(-) be the union of all fibers of the bundle P over our 
curve (|3.ip , where P is the bundle over the orbit O defined in section [3l Our goal is to assign to 
the curve A(-) in a canonical way a fiber subbundle of -P|a( ) endowed with a canonical Ehresmann 
connection, i.e. with a rank 1 distribution transversal to its fibers. We shall construct this bundle 
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through the iterative construction of decreasing sequence of fiber subbundles of -P|a(-)- Define a 
map 

-1 -1 

(4.2) Ui : Rom{Vi,K{t)) ^ }iom{Vi, Ai{t)/Ai+k+i{t)) 

i=—li i=—fi 

as follows: 

Ui{A)\v, =A\v, modA,+fe+i(t), V-/i<i<-l. 

Let Pq be the subbundle of -P|a(-) with the fiber -Po(i) over the point {Aj(t)}^^_^ consisting of 
all A G PA(t) such that 

m = K{A-'^ o 5t o A) _^ 

We also denote by Pq the bundle over our curve with the fiber Po{t) over the point {A.i{t)}~}_^ 

equal to the image of the corresponding fiber Po{t) of the bundle Pq under the map IIq. By 
constructions Pq is a principal f7o-bundle, where Uq is a subgroup of Q consisting of all degree 
elements B oi Q such that Adi?(m) = m. The Lie algebra of Uq is equal to Uq defined by (|4.ip . 

4.3. Quasi-principal subbundle of Pq. Take a fiber subbundle P of Pq which is not necessary 
a principle subbundle of Pq. Let P(t) be the fiber of P over the point {^i{t)}^^_^. Take e P{t)- 
The tangent space T^(^P{tj) to the fiber P{t) at a point ijj can be identified with a subspace of 
Qiiy). Indeed, define the following g+-valued 1-form a; on P: to any vector X belonging to 
T^(yP{t)) we assign an element uj{iI)){X) of £|+ as follows: if s ^ '^{s) is a smooth curve in P(t) 
such that '(/'(O) = V' ^'^^ i^'i^) = ^ then let 

(4.3) w(V')(a:) = V"^ ox, 

where in the last formula by ip we mean the isomorphism between V and W. Note that the linear 
map uJ{^p) : T^{^P{t)) ^ g+ is injective. Set 



(4.4) L^:=uj{T^{P{t)). 

If P is a principle bundle over our curve, which is a reduction of the bundle Pq, then the space 
is independent of ifj and equal to the Lie algebra of the structure group of the bundle P. For 
our purposes here we need to consider more general class of fiber subbundles of Pq. To define this 
class recall that the filtration given by the subspaces , < i < —1, defined by (|3.3p . induces a 
natural filtration on Qi{V) and, therefore, on the subspace L^. The corresponding graded subspace 
is called a symbol of the bundle P at a point ip. Under the natural identification of spaces 
grg[(y) with g[(gr F), described in the beginning of section [21 one has that grL^ is a subspace of 
g[(grl/). Besides V is a graded space by definition, i.e V ~ grF. Therefore, grL^ is a subspace 
of gl(F). 

Definition 4.2. We say that the bundle P has a constant symbol s if its symbols at different 
points coincide with s. In this case we call P the quasi-principle subbundle of the bundle Pq with 
symbol s. 
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4.4. Structure function associated with Ehresmann connection. Further, assume that a 
fiber subbundle P of Pq is endowed with an Ehresmann connection, i.e. with a rank 1 distribution 
T-L transversal to its fibers. A parametrized smooth curve t ^ ^{t) in P is called a moving frame 
of the pair {P,7i) if the following two conditions holds: 

(1) the curve 1 1-^ tpit) is tangent to the distribution T-L at any point; 

(2) there exists (5 G m such that [tP~^ o tp^t)) = 6 for any t. 

A pair (P, 7i) will be called a bundle of moving frames. 

Let = Hom(m, g). Also, given A E qI{V) denote by {A)f^ the component of degree k of 
A (w.r.t. the splitting 3l(V^) = ^^bK^)^)- Then to any bundle P with the fixed Ehresmann 

connection Ti one can assign the function c : P — )■ as follows: Given tp E P{t) and 5 G m 
let iP{t) be a curve in P tangent to the Ehresmann connection H such that ip{t) = %[) and 
o ip'{t))_^ = 5. Then set 



(4.5) c{iP){5):=i^-\t)oi;'{t). 

Note that the righthand side of (|4.5p does not depend on the choice of the curve ip{tau) with the 
aforementioned properties. The function c is called the structure function of the pair the bundle 
of moving frames (P, 

Remark 4.1. Under the identification of the bundle P with the Lie group Q given in Remark 13. II 
one can describe the structure function c{ip) in terms of the left-invariant Maurer-Cartan form VL 
of Q by the following formula: 

(4.6) c{'4))[{yt{X)) _^ = n{^){X) e P and X G ?^(V'), 

where (0(X))_^ is the degree —1 component of Q.{X) with respect to the grading on q. Note also 
that the g+-valued 1-form uj defined by (|4.3p is nothing but the restriction of the left-invariant 
Maurer-Cartan form to the fibers of the bundle P. □ 

Note that 

(4.7) C' = ®Cl 

where = Hom(m, g^-i)- Let := ^^Cl, c^ be the kih. component of c w.r.t. the splitting 

fe>0 

()4.7p . and c+ = Yl,k>QO ^k- We say that c+ is the positive part of the structure function of c. Note 
that by the constructions Cfc = for /c < and cq{5) = 5 for every J G m. 
Further, let 9 : g ^ be the operator given by the following formula: 



(4.8) dx{5) = [5, x] , Vx G 0, 5 G m. 

Remark 4.2. As a matter of fact, one can look on g and as on the spaces of 0-cochains and 1- 
cochains, respectively, on m with values in g. Moreover, the operator d is exactly the coboundary 
operator associated with the adjoint representation ad : m ^ g^fl)- 

Recall also that the group acts naturally on the space as follows: 

(4.9) {A.c){5) = {MA)cU{MA-^)5) _X a G a+, 5 G m. 
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where ((Adyl~^)(5) is a degree —1 component of {AdA^^)6 with respect to the grading of g. 
Obviously, this action restricts to the action on C}^_. 

Finally, let u+(m) = ^^u^ and let U+{m) be the subgroup of the group of symmetries of the 

k>0 

curve t i-T- {e*^y*}i=_i^...^_^ preserving the filtration {V^}^J:_^. Note that u+(m) is the Lie algebra 
ofC/+(m). 

A subspace J\f complimentary to the space Hom(m, u+(m)) + {Imd fl C^) in C\_ is called a 
normalization condition. We say that an Ehresmann connection Ti on a subundle P of Pq satisfies 
the normalization condition M if the positive part of the structure function of the pair ("P, %) 
takes values in J\f. 

Our main theorem can be formulated as follows: 

Theorem 4.1. Fix a normalization condition J\f. Then for a curve of flags ()3.ip with constant 
symbol with representative m there exists a unique quasi-principal suhbundle P of the bundle 
Pq with symbol u^{m) and a unique Ehresmann connection % on it such that this connection 
satisfies the normalization conditions M . If, in addition, the space M is invariant with respect to 
the natural action of the subgroup [/+(m) on C^, then the bundle P is the principal bundle with 
the structure group Uj^{m). 

The pair (P, %) from the previous theorem is called the bundle of moving frames canonically 
associated with the curve (j3.ip via the normalization condition N and the Ehresmann connection 
% is called the canonical Ehresmann connecton on P associated with the curve (|3.ip via the 
normalization condition Af. 

Theorem 14.11 is proved in the next section. As a direct consequence, we have that two curves 
{^i}7=-fi {^i}7=-fi flags with constant symbol m are equivalent through ^4 G G if and 
only if for any moving frame t i— > ilj{t) of the pair (the bundle P, the Ehresmann connection Ti) 
canonically associated with the curve {Aj}^^_^ via Af the curve 1 1— t- Ao^(t) is the moving frame 

of the pair (the bundle P, the Ehresmann connection 71) canonically associated with the curve 
{Ai}ri_^ via Af. 

Remark 4.3. Note that in the case when the normalization condition Af is invariant with respect 
to the natural action of the subgroup C/+(m) on C^, the canonical Ehresmann connection is not 
a principal connection on the corresponding C/+(m)— principal bundle in general. It is a principal 
connection if the first algebraic prolongation ui is equal to 0. 

4.5. On geometry of parametrized curves of flags. Similar results can be obtained for 
equivalence problem for parametrized curves of flags with respect to the action of group G. There 
are only three modifications. The first modification is that the symbol of a parametrized curve is 
an orbit of an element (and not a line) in 0_i with respect to the adjoint action of Then we 
fix a representative 5 of this orbit. The second modification is in the definition of the algebra Uq 
and of the bundle Pq. Let 6 G g_i. Set u_i = K6 and 

(4.10) Uo:={X €Qo:[X,6]=0}. 

The spaces for k > are defined recursively, using (|4.ip . The third modification is in the 
definition of the bundle Pq (the zero degree reduction of the bundle P\a{-))- Here Pq should be 
the subbundle of -P|a( ) with the fiber Po{t) over the point {Aj(i)}~3_^ consisting of all A G PA{t) 
such that 

S= {A^^ o 6t o A) 
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With these modifications ah other constructions and Theorem 14. II are vaHd. 

4.6. On geometry of submanifolds of constant type in flag varieties. Similar theory can 
be constructed for equivalence problem for submanifolds of dimension I of O with respect to the 
action of the group G. Again we consider submanifolds compatible with respect to differentiation. 
A submanifold is compatible with respect to differentiation if any smooth curve on it is compatible 
with respect to differentiation. A symbol of an /-dimensional submanifold 5 C O at a point A 
is an orbit of an /-dimensional abelian subalgebra m (of q) belonging to Q-i with respect to the 
natural action of on /-dimensional subspaces of of This subalgebra can be taken as a 
linear span of all elements of type (^A~^ o 5t o Aj where A is a fixed element of the fiber Pa 
and 5t are elements of gr^ W corresponding to all possible smooth curves in S, passing through 
A. Note that the word "abelian" can be removed, because any subalgebra of g that belongs to 
0-1 must be abelian. 

Further, one can define the bundle Pq over the submanifold S as in subsection 14.21 the notion 
of a quasi-principal subbundle of the bundle Pq as in subsection 14.31 an Ehresmann connection 
of P i.e. a rank / distribution H transversal to its fibers, and a moving frame of the pair (P, H) 
as in subsection 14. 4[ The structure function of the (P, ^) can be defined by the relation (j4.6|) . 
Note that since m is abelian, the structure function at any point tp £ P takes its values in the 
space of 1-cocycles (with respect to the coboundary operator associated with the adjoint 
representation ad : m — )• 01(0), see Remark 14. 2p . Therefore, to get the generalization of Theorem 
14.11 to submanifolds with a constant symbol in flag varieties (with literally the same proof as in 
section [5] below) one has to replace C\. by in the formulation of this theorem, where Z^ is the 
subspace of cocycles in C}^_. It is clear that in the case of curves Z^ = . 

Finally note that one can consider more general situation of filtered submanifolds of constant 
type in flag variety, which is encoded by fixing a graded subalgebra in a negative part of (not 
necessary belonging to 0-1. This point of view is considered in the recent preprint [12] . 

5. Proof of Theorem 14.11 

We construct a decreasing sequence of flber subbundles of the bundle Pq by induction. 
First let us introduce some notations. If M is the space from the formulation of Theorem 14. 
denote 

(5.1) ^rk = ^fr^cl, a^sn 

Then obviously M = ^Mk- 

km 

Note also that there is a natural mappings pr^ : C^— )'Hom(m, 0j!c_i/ufc_i) such that for any 
Cfc € Cl and (5 G m we set pr^(cfc)(5) to be the equivalence class of Ck{6) in 0fc_i/ufc_i. We assume 
that 

(5.2) Jfk = prfc(A4). 

Further, let 0^ be as in ()3.4p . Then the image of the restriction of the operator d to the subspace 
Qk belongs to C^. We denote this restriction by dk, dk Qk ^ C\. Finally, let 

(5.3) dk=Wk°dk. 

Note that by constructions the space deflned by ()4.ip is nothing but the kernel of the map dk , 
Ufc = ker 
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5.1. First degree normalization. First take some Ehresmann connection on the bundle Pq and 
let ci be the degree 1 component of the structure function of the bundle Pq with this Ehresmann 
connection. If one takes another Ehresmann connection on Pq and the corresponding degree 1 
component ci of the structure function of Pq with this new Ehresmann connection, then 

(5.4) ci (ip) [5] - ci (V') (<5) G uo VV' G Pq and (5 € m 

In other words, the map ci : Pq ^ Hom(m, Qq/uq), defined by ci{ip) = pii o ci{ip), is independent 
of a choice of an Ehresmann connection on Pq. 

Now take ipi and tp2 from the same fiber -Po(t) such that IIq{iPi) = IIq{^2) and study how 
ci{tpi) and ci(V'2) are related. As before given A G qI{V) denote by (A)^ the component of degree 
koi A (w.r.t. the splitting Qi(y) = ^Q[{V)k). Set 

(5-5) 4,^^ :=(Vr' 0^^2)1. 

It is not hard to see that fip^ip-^ G 0i, where gi is defined by ()3.4p . In opposite direction, for fixed 
V'l G Po{t) and any / G 0i there exists ip2 G Po(*) such that n^(V'i) = ^oii^2) and / = f^^^^^- 

Lemma 5.1. The following identity holds 

(5.6) ci(v^2) = ci(Vi) + ai(4,^j. 

Proof. First note that 

(5.7) 4,^, = (n*(V'i))~' o (n*(V'2) -nUVi)). 

or, equivalently, 

(5.8) 'iP2{v) = Mv) + n*o(Vi) o mod Ai+2(t) Vt; G Vi. 
Let ipiir), z = 1, 2 be a section of Pq such that ipi{t) = ipi and 

(5.9) {i'-^o4{t))_^ = 5 

Then one can write the identity analogous to ()5.8p for any r. Differentiating it at r = t and using 
(|5.9p again we get 

(5.10) V2(i)(^) = ^'i(i)(^) + nf)(Vi) o 5 o 4,^,(7;) mod Ai+i(t) Vt; G y.. 
Applying 1^2^ to both sides and using (|5.9p again one gets 

(5.11) V'2~' ° V'2(i)(^) = V'2~' ° V'U*)!^) + ^ o 4,^2 (^) mod A,+i(t) Vt; G Vi. 
Representing ^/;^^ o ^'^{t) as '(/'2'^ o o o V'UO and taking into account that 

11)2^ 0^1 = Id — /^^^^2 + operators of degree > 2, 

V^r^ ° V'i(^) = 15 + ci(V'i) + operators of degree > 1 mod uq. 

we get that 

(V^-^ o = ci(^i) - 4,^2 ° "0. 

Finally, comparing 0-degree components of identity ()5.1ip we get the required identity ()5.6p . □ 
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Now take the space TVi as in (|5.ip . By our assumptions on TV we have 

(5.12) Hom(m,go/uo) = Im^i e ATi. 

Let Pi be the subbundle of the bundle Pq consisting of all ip Pq such that ci('i/') G A^i. From 
formula ()5.6p and splitting ()5.12p it follows that the bundle Pi is not empty. Moreover, ■0i and 
'tp2 from the same fiber Pi{t) satisfy nQ(V'i) = IIq{iP2) if and only if /^^ G ker^i = Ui. 

We also denote by Pi the bundle over our curve with the fiber Pi{t) over the point {^i{t)}^J:_^ 

equal to the image of the corresponding fiber Pi{t) of the bundle Pi under the map 11^. By above 
Pi can be considered as an affine bundle over Pq such that its fibers are affine spaces over the 
vector space Ui. The projection of the bundle is induced by the maps IIq. 

Note that in the constructions of the bundles Pi and Pi we did not use the whole information 
on the space TVi, but on its image under the (non-injective) map pri only. So, from the knowledge 
of the whole space A/i we should get additional restrictions on the bundle of moving frame we are 
looking for. Indeed, by our assumptions on J\f we have the following splitting 

(5.13) (pri)-i(Ari) =M eHom(m,Uo). 

From this splitting and relation (|5.4p it follows that one can choose an Ehresmann connection 
on Pi such that the degree 1 component ci of the structure equation of Pi with this Ehresmann 
connection belongs to TVi. Moreover, any such Ehresmann connection on Pi induces the unique 
Ehresmann connection on the bundle Pq. 

5.2. Higher degree normalizations: the induction step. Given i > assume that there 
exists a unique series of bundles Pk, 1 < k < i over our curve such that Pq is as above and for 
each 1 < k < i the bundle P^ satisfies the following properties: 

(Al) Pfc is a subbundle of Pfc-i; 

(A2) if c is the structure function of P^ (endowed with some Ehresmann connection) and q is 
its degree I component, then 

(5.14) pr^oQGAT; yi<l<k 

(A3) if Pfc, < k < i, is the bundle over our curve with the fiber Pk{t) over the point {Aj(t)}~J:_^ 

equal to the image of the corresponding fiber Pk{t) of the bundle Pk under the map 11^, 
then Pfc can be considered as an affine bundle over Pfc-i such that its fibers are affine 
spaces over the vector space Ufc. The projection of this bundle is induced by the maps 

TTt . 

(A4) there exists an Ehresmann connection on the bundle P^ such that the structure function 
c satisfies 

(5.15) QSTV/ V1</<A:. 

Moreover, any such Ehresmann connection on P^. induces the unique Ehresmann connec- 
tion on the bundle Pfe_i. 

Now let us construct the subbundle Pj+i of Pi, corresponding to the normalization of degree 
z + 1. For this first take some Ehresmann connection on Pj satisfying ()5.15p (with k = i) and let 
Cj+i be the degree i + 1 component of the structure function of the bundle Pi with this Ehresmann 
connection. If one takes another Ehresmann connection on Pj satisfying ()5.15p (with k = i) and 
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the corresponding degree i + 1 component Cj+i of the structure function of Pj with this new 
Ehresmann connection, then 

(5.16) Ci+i{'ip){5) - Ci+i{'ilj){5) eui e Pi and 5 e m. 

In other words, the map Cj+i : Pi Hom(m, gj/uj), defined by Cj+i(V') = pr^+i ° Ci+i(V')) is 
independent of a choice of an Ehresmann connection on Pi. 

Now take ipi and ijj2 from the same fiber Pi(t) of the bundle Pi such that 11* (^/^i) = Il^^{ip2) and 
study how Ci+i(V'i) and Cj+i(V'2) are related. Set 

(5-17) ri!^.--=i^i'°^2),^,. 

It is not hard to see that € Qi+i, where g^+i is defined by p.4p . In opposite direction, for 

fixed t/ji G Pi{t) and any / e g^+i there exists ^2 G -Pi(i) such that n^(V'i) = n-(V'2) and/ = f^^^^^- 
By the complete analogy with the proof of Lemma 15.11 one gets the following identity 

(5.18) Q+i(V2) = c,+i(^i) + a,+i(/;+;j. 

Further take the space A/i+i as in (|5.ip . By our assumptions on Af we have 



(5.19) Hom(m,gi/ui) = ImSj+i eATj+i. 

Let Pj+i be the subbundle of the bundle Pi consisting of all ijj ^ Pi such that Cj+i('0) € 'J^i+i- 
From formula ()5.18p and splitting (|5.19p it follows that the Pj+i is not empty. Moreover, ipi and 
il)2 from to the same fiber i-*j_(_i(t) satisfy n*(V'i) = n*(-i/'2) if and only if /^^^^ ^ ker 9j = Uj+i. 

We also denote by Pi+i the bundle over our curve with the fiber Pj+i(i) over the point 
{Aj(t)}j^_^ equal to the image of the corresponding fiber i-i+i(t) of the bundle Pi+i under 
the map H*^^. By above Pj+i can be considered as an affine bundle over Pj such that its fibers 
are affine spaces over the vector space Uj+i. The projection of the bundle is induced by the maps 
n*. So, the bundles Pj+i and Pj+i satisfy conditions (A1)-(A3) above (for k = i + 1). 

To construct an Ehresmann connection Pj+i, satisfying condition (A4), consider the splitting 

(5.20) (pr»+i)~^(Ari+i) = Ni+i e Hom(m,Ui). 

From this splitting and relation (|5.16p it follows that one can choose an Ehresmann connection 
on Pj_|_i such that the degree i+1 component Cj+i of the structure equation of Pj+i with this 
Ehresmann connection belongs to A/i+i. Moreover, any such Ehresmann connection on Pj+i 
induces the unique Ehresmann connection on the bundle Pi. This completes the induction step. 

Since Ufc = for k > fj, and the maps 11* are identities for i > fi — 1, the sequence of bundles 
{Pj}j>o stabilizes from i = — 1, i.e. Pj = Pj+i for i > /i — 1, and also Pi = Pi for i > /x — 1. 
Moreover, the bundle P^ (= P^) is endowed with the unique Ehresmann connection such that its 
structure function satisfies (j5.15p with k = fi. 

We claim that the bundle P^ with the constructed Ehresmann connection is the bundle we are 
looking for in Theorem l4.ll By construction the positive part of the structure function of P^ takes 
values in M. Let us check that the bundle P^ has symbol u+(tn). By the previous constructions 
we have the sequence of the bundles {Pi}f^Q such that Pj+i is a bundle over Pj. Hence, P^ can 
be considered as a bundle over each Pj with < i < fi. Take ip £ Pfj, and consider the fibers of 
P^ considered as a bundle of Pj for each < i < fi. The tangent spaces to this fibers at define 
the filtration on T^P^[t). Let (jJ and be as in ()4.3p and ()4.4p respectively. The images of the 
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spaces of the filtration on T^P^{t) under the map (^{ij:) define the filtration on the space . By 
our constructions this filtration coincides with the filtration induced on from 0l(y). Moreover, 
by property (A3) the graded space gr of coincides with u+(tn). In other words, the bundle 
has constant symbol u+(m). So, satisfies all conditions of our theorem. Moreover, all 
conditions we imposed on the structure function of during the proof were necessary, which 
proves the uniqueness of the constructed bundle and completes the proof of the first part of our 
theorem. 

Note that by our constructions the bundle P^ (without a specified Ehresmann connection on it) 
can be uniquely determined by the subspace AT = ^^A/^ of Hom(m, 0+/u+(m)) : the bundle 

^ A:>0 

consists of all ^ G Pq such that Cj(V') G Mi for all 1 < i < /x. The natural action of C/+(na) on C\ 
defined by (|4.9p induces the action on Hom(m, 0+/u+(m)) . Now assume that is invariant with 
respect to the action of C/+(m) on C^. Then the corresponding space U is invariant with respect 
to the action of U+{m) on IIom(m,0+/u+(m)). This implies that if ■0 G P/x then -0 o P £ P^i for 
any B G C/+(m), which implies that the bundle P^ is a principal C/-|-(m)-bundle. This completes 
the proof of the second part of our theorem. 

6. Refinement procedure 

Here we explain the origin of the condition of compatibility with respect to differentiation via 
the so-called refinement procedure in the cases of the standard representations of the classical 
groups and the case G = Aff(W^). 

6.1. The case G = SL{W), GL{W), and Aff(l^). The constructions of this subsection work 
for any group G such that any orbit O of flags is compatible with respect to some grading of 
the corresponding Lie algebra g. Starting with a curve of flags (|3.ip compatible with respect 
to differentiation, we can build a finer curve of flags compatible with respect to differentiation. 
For this flrst given a curve t i— > L{t) of subspaces of W (parametrized somehow), i.e. a curve in 
a certain Grassmannian of denote by C{L) the canonical bundle over L: the fiber of C(L) 
over the point L{t) is the vector space L{t). Let r(L) be the space of all sections of C(L) . Set 
L^^\t) := L{t) and define inductively 

L^^\t) = spani^m : £ G r(L),0 < k < j} 

for j > 0. The space L^^\t) is called the jth extension or the jth osculating subspace of the curve 
L at the point t. The compatibility of the curve of flags ()3.ip with respect to differentiation is 
equivalent to the condition A^^\t) C Aj_i(t) for any — /i + 1 < « < — 1 and for any t. 

Further given a subspace L in W denote by the annihilator of L in the dual space W*: 
= {p eW* : {p,v) = 0, Vw G L}. Set L(-J)(t) = ((L(t)^)(j))^ for j > 0. For any curve 
t 1-^ L{t) in a Grassmannian we get the nondecreasing filtration {L^^\t)}j(=z of W. If dimensions 
L^^\t) are independent of t for any j > 0, then the subspaces L^^\t), j < 0, can be also defined 
inductively by L^^^t) = Kevf^L^^+^\t). 

Now take a germ of the curve ()3.ip at a point t and assume that it is compatible with respect 
to differentiation. Assume that there exists a neighborhood lA olt such that one of the following 
assumptions hold: 

(Bl) For T the dimension of subspaces [a[^\t)) is constant, the subspace a[^\t) is strictly 

(2) 

between Ai{t) and Aj_i(t), and one has the inclusion A- (r) C Aj_i(T); 
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(B2) For T ^ hi the dimension of the space (A- (t)) is constant, the subspace A^ ' {t) is 
strictly between Aj_|_i(t) and Aj(t), and one has the inclusion Aj+i(r) C A- (r) (or, 
equivalently, Aj^\(r) C aJ"^^)) 

Note that for i = // + 1 the condition A- (r) C Aj_i(r) holds automatically in (Bl) and for 

i = —1 the condition Aj4.i(r) C A- (r) holds automatically in (B2). 

If assumption (Bl) holds, then we can obtain a new germ of a curve of flags by inserting in (|3.ip 

the space ^^^{t) between Aj(r) and Aj_i(r) for any t £ U . We call such operation elementary 
refinement of the first kind. In the same way if assumption (B2) holds, then we can obtain a new 

germ of a curve of flag by inserting in ()3.ip the space A- ^\t) between Aj+i(T) and Aj(r) for 
any t £ U. We call such operation elementary refinement of the second kind. In both cases we 
renumber the indices of subspaces in the obtained flags from —1 to — — 1. The germ of a curve 
of flags t is called a refinement of the germ of the curve ()3.ip at t, if it can be obtained from this 
germ by a sequence of elementary refinements (either of the first or the second kind). 

By construction any refinement preserves the property of compatibility with respect to dif- 
ferentiation. Besides, if two curves are G-L(l^)-equivalent, then the corresponding refinements 
are GL(l^)-equivalent. Further, the refinement procedure defines a partial order on the set of all 
germs of smooth curves of flags in W, which also induces a partial order on the set of all refinements 
of the germ of the curve (|3.ip at t. In general a curve of flags admits several different maximal 
refinements with respect to this partial order. Finally, for a curve t i— > L{t) in a Grassmannian of 
W consider the corresponding trivial curve of flags f i— )• {0 C L{t) C W}. Then it is easy to show 
that in a generic point the germ of such curve of flags has the unique maximal refinement, which is 
exactly the curve 1 1— )• {L^^^ {t)}j^i of all osculating subspaces of the curve L (truncated and renum- 
bered in an obvious way). The corresponding map 6t G ^^}iom(^L^ {t)/L^^^{t), L^^^{t)/L^ (t)^ 

satisfies the following properties: the restriction of 5t on U [t]/ U~^{t) is surjective for j < 
and 6t sends {U {t) / U~^{t) onto U^^{t)/ U {t). for j > 0. Hence the symbol of the curve 
t I— )• {L^^\t)^j,zj^ satisfies similar properties. Note that the symbol of a curve of flags at a given 
point is in essence the tangent line to a curve. The symbol of the refined curve of flags contains 
an important information about the jet space of higher order of the original curve. So, fixing the 
symbol of refined curve of flag instead of the original one, we fix more subtle classes of curves 
and our prolongation procedure is more accurate: the dimension of the algebraic prolongation 
of the symbol of the refined curve (which in turn is equal the dimension of the canonical bundle 
of moving frames for the refined curve) might be significantly smaller than the dimension of the 
corresponding objects for the original curve. 

Example 6.1. (N on- degenerate curve in projective space) Consider a curve t i— >■ L[t) in a projec- 
tive space ¥'W of an n + 1-dimensional vector space W ^ i.e. a curve of lines in W . Without making 
a refinement procedure the symbol at a generic point of a curve, which does not degenerate to 
a point, is a line of degree —1 endomorphisms of the corresponding graded space having rank 1 
and the flat curve corresponds to a curve of lines in W depending linearly on a parameter ( or , 
equivalently, it is a projective line linearly embedded to PVF). Obviously, the universal algebraic 
prolongation coincides with the subalgebra of 0l(I1^) preserving the plane, generated by the lines 
of a flat curve. Now consider so-called non-degenerate curves in PVF, i.e. curves which do not lie 
in any proper subspace of ¥W . For such curve the nth osculating space at a generic point t is 
equal to the whole W, L^"'\t) = W. The maximal refinement of the curve t i— > {0 C L(t) C W} 
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is the curve of complete flags 

t^{OC L{t) C L^^\t) C . . . L(")(t) = W}, 

as in Example 1 3 . II ab ove . As already mentioned there the symbol of such curve is a line of degree 
— 1 endomorphisms of the corresponding graded spaces, generated by an endomorphism which 
has the matrix equal to a Jordan nilpotent block in some basis and the curve in projective space 
corresponding to a flat curve of complete flags is the curve of osculating subspaces of a rational 
normal curve in the projective space PVK. Finally, from Theorem 18 . 1 1 b elow (see also the sentence 
after it) it follows that the universal algebraic prolongation of this symbol is isomorphic to 
(or s[2 in the case G = SLiyV)), which also follows from the well-known fact that the algebra 
of infinitesimal symmetries of a rational normal curve is isomorphic to (or 5X2 in the case 
G = SL{W)). In this case one can show that the normalization condition can be chosen to be 
invariant with respect to the natural action of the subgroup C/-f(m) (which is isomorphic in this 
case to the group the upper-triangular matrices) on G\. and in this way the classical complete 
system of invariants of curves in projective spaces, the Wilczynski invariants, can be constructed 
(see [E] or [10] for the detail). □ 

6.2. The case G = SpiyV) or G = GSp{W). Here W is equipped with a symplectic form a. In 
this case, by Proposition 12.21 our theory works for curves of symplectic flags as in Definition 12.11 
Given a curve t 1-^ L{t) in a Grassmannian of W denote by t 1-^ -^^(0 the curve of subspace of 
W such that the space L^{t) is the skew-symmetric complement of the space L{t) with respect to 
the symplectic form a. Starting with a germ of a curve ()3.ip of symplectic flags compatible with 
respect to differentiation and applying an elementary refinement as in the previous subsection, 
we obtain non-symplectic flags in general. Therefore we need to modify the definition of an 
elementary refinement appropriately. Such modification is based on the following simple fact: if 
t 1-^ L{t) is a curve of coisotropic or isotropic subspaces of W then {L^^^)'^{t) = {L'^)^^^\t). We 
say that a refinement of a curve of symplectic flag t 1— )■ {Aj(t)}jg2 is an elementary symplectic 
refinement in one of the following 2 cases: 

(CI) If condition (Bl) holds with subspaces Aj(r) being coisotropic, then an elementary sym- 
plectic refinement of the first kind consists of inserting a\^\t) between Aj(T) and Aj_i(r) 
and inserting {Af)^~^\T) between (Aj_i)^(r) and (Aj)^(r) for any t ^lA; 

(C2) If condition (B2) holds with subspaces Aj_|-i(r) being coisotropic, then an elementary 
symplectic refinement of the second kind consists of inserting A^ "^^(r) between Aj+i(r) 
and Aj(r) and inserting {Kf)'^^\T) between (Aj)'^(r) and (Aj+i)'^(r) for any t (^U; 

(C3) If Aj(T) is isotropic and Aj_i(r) is coisotropic (which implies by assumptions that Aj„i(r) = 
A^(r), then assume that (Aj)(-'^)(r) is isotropic, of constant dimension in U, Aj(r) is strictly 
contained in (Aj)(-'^^(r), and A^^^ C A^-_Wt). An elementary symplectic refinement of the 
third kind consists of inserting Aj{T) and a[_Wt) between Aj(r) and Aj_i(r) (if Aj{T) 
and A-_J^(r) coincide they count as a one space). 

By analogy with the previous subsection one can define a symplectic refinement as a composi- 
tion of elementary symplectic refinement. By construction the resulting flag under a symplectic 
refinement is symplectic and compatible with respect to diferentiation. Also the refinement pro- 
cedure defines a partial order on the set of all germs of smooth curves of symplectic flags in W. 
In general, similar to the previous subsection, a curve of symplectic flags admits several different 
maximal symplectic refinements with respect to this partial order. There is a unique maximal 
refinement for the germs at generic points of the following two types of curves of symplectic flags: 
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t I— )• {0 C L{t) C W}, where spaces L(t) are Lagrangian, i.e. isotropic of dimension ^ dimW, and 
t {0 C L{t) C L'^{t) C W}, where spaces L{t) are proper isotropic. In the first cases we can 
use elementary refinement of the first kind only and the maximal refinement coincides with the 
fiag associated with a curve in a Lagrangian Grassmannian, introduced in In the second 

case one can use elementary refinements of the first and third kinds only. 

6.3. The case G = 0{W) or G = GO{W). Here W is equipped with a non-degenerate symmetric 
form Q. The elementary refinement are defined in completely the same way as in the symplectic 
case: isotropic and coisotropic subspaces are taken with respect to the form Q and instead of 
skew-symmetric complement one takes orthogonal complements with respect to Q. 

7. Classification of symbols of curves of flags with respect to classical groups 

We describe all symbols of curves of fiags with respect to GL{W) (equivalently, SL{W)) , 
Sp{W) (equivalently, CSp{W)), and 0{W) (equivalently, GO{W). According to Remark [Q it 
can be used for any representation of classical groups. 

7.1. The case of GL{W){SL{W)). Let 6i and 62 be degree —1 endomorphisms of the graded 
spaces Vi and V2 , respectively. The direct sum Vi © V2 is equipped with the natural grading such 
that its ith. component is the direct sum of ith components of Vi and V2. The direct sum 5i © 82 
is the degree —1 endomorphism of Vi © V2 such that the restriction of it to Vi is equal to 6i for 
each i = 1,2. A degree —1 endomorphism 5 of a graded space V is called indecomposable if it 
cannot be represented as a direct sum of two degree —1 endomorphisms acting on nonzero graded 

s 

spaces. Further, given two integers r < s < let Vrs = ^^^i^ where dimE'j = 1 for every i, 

i=r 

r < i < s, and let 6rs be a degree —1 endomorphism of Vrs which sends Ei onto Ei-i for every i, 
r < i < s, and sends Er to 0. Then clearly 5rs is indecomposable. 

The following theorem gives the classification of all symbols of curves of fiags (both of un- 
parametrized and parametrized) with respect to the General Linear group: 

Theorem 7.1. A degree —1 endomorphism 5 of a graded space (indexed by negative integers) 
is conjugated to the direct sum of endomorphisms of type 6rs- Moreover, for any two integers 
r < s < the number of apperance of 5rs in this direct sum is an invariant of the conjugate class. 

Proof. We will proceed as in the classical proof of Jordan Normal Form Theorem (see, for exam- 
ple, [22', chapter 3]). The only difference is that one has to take into account the grading on the 
ambient space V as well. Let 5 be a degree —1 endomorphism of V. Then 5 defines the addi- 
tional filtration on V via generalized eigenspaces of different orders (corresponding to the unique 
eigenvalue 0), namely ker(J) C ker{6'^) C . . .ker(5^"'"^) = V. In the first step choose a tuple of 
vectors in V consisting of homogeneous vectors (with respect to the grading on V) such that their 
images under the canonical projection to the factor space ker((5'+i)/ker(5') constitute a basis of 
ker((5^+^)/ker((5'). Then take the images of vectors of this tuple under 6. Since 6 is of degree — 1, 
these images are homogeneous vectors in V belonging to ker((5'). Complete the tuple of these 
images (if necessary) to a tuple of homogeneous vectors in ker(5') such that the images of vectors 
in this tuple under the canonical projection to the factor space ker((5')/ker((5'~^) constitute a basis 
of ker(^')/ ker((5'^^). Continuing this process we will get a basis of V consisting of homogeneous 
vectors such that the matrix of the operator 6 in this bases has a Jordan normal form. Each 
Jordan block corresponds to an indecomposable endomorphism of type 6rs- This proves that 5 is 
conjugated to the direct sum of endomorphisms Srs- The invariance of the number of appearance 
of 6rs in this direct sum can be easily obtained from the above construction as well. □ 
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The previous theorem also shows that the endomorphisms 6rs are the only indecomposable 
degree —1 endomorphisms, up to a conjugation, of a graded space (indexed by negative integers). 

7.2. Symplectic case. Let := {| : i € Z} and ^Zodd := ^\^odd = {i + ^ : i € Z}. It is more 
convenient for a symplectic flag to make a shift in the indices (either by an integer or by a half of 
an integer) such that (Aj)^ = A_j+j^.aci2 for any i in Z or |Zodd- In the sequel the subspaces in 
symplectic flags will be enumerated according to this rule. 

s 

Assume that V = Vi is a graded space, Vr ^ 0, Vg ^ 0, and a symplectic form a is given 

i=r 

V. We say that this grading is symplectic (or y is a graded symplectic space) if the corresponding 
flag 

(7-1) {V'U^ 1^^,,, where ^ = V„ 

is symplectic and also the subspaces Vi and Vj are skew orthogonal for all pairs {i,j) with i + j< 
r + s. As in the previous subsection, the notion of indecomposibility plays the crucial role in 
the classification. Let 6i and 82 be degree —1 endomorphisms of the graded symplectic spaces 
Vi and V2, respectively, belonging to the corresponding symplectic algebras. The direct sum 
Vi © V2 is equipped with the natural symplectic grading such that its ith component is the direct 
sum of ith components of Vi and V2 and the symplectic form on Vi © V2 is defined as follows: 
the restriction of this form to Vi coincides with the symplectic form on Vi for each i = 1,2 and 
the spaces Vi and V2 are skew-orthogonal in Vi © V2. The direct sum 5i © 62 is the degree — 1 
endomorphism of Vi © V2 (belonging to 5p{Vi © V2)) such that the restriction of it to Vi is equal 
to di for each i = 1,2. A degree —1 endomorphism 5 € spiV) of a graded symplectic space V is 
called symplectically indecomposable if it cannot be represented as a direct sum of two degree —1 
endomorphisms acting on nonzero graded spaces and belonging to the corresponding symplectic 
algebras. 

Remark 7.1. Note that we can add two graded symplectic spaces and two degree —1 endomor- 
phisms on them if and only if either the grading on both spaces are indexed by Z or the grading 
on both spaces are indexed by ^Zodd-D 

Below we list two types of symplectically indecomposable degree —1 endomorphism: 
(Dl) Given a nonnegative s S ^Z, and an integer / such that < / < 2[s] let V^^^ be a linear 
symplectic space with a basis 

(7.2) {cs-i, . . . ,es,f-s, ■ ■ ■ , fi-s} 

such that a{ei,ej) = cr{fi,fj) = 0, cr{ei,fj) = (-l)"""*, if j = -i, and (j{ei, fj) = if 
j 7^ —i. Define the grading on T/^^ such that the ith component equal to the span of 
all vectors with index i appearing in the tuple ()7.10p . It is a symplectic grading. Then 
denote by d^J'^ a degree —1 endomorphism of V^^^ from the symplectic algebra such that 
= for s - / + 1 < i < s, 5l^^^{es-i) = 0, 5^|',(/i) = fi-i for -s + 1 < i < I - s, 
and 6%if.s) = 0. 
(D2) Given a positive m € ^Zodd let 

— m < i < m, 
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be a symplectic graded spaces such that dim Ei = 1 for every admissible i and let Tm be 
a degree —1 endomorphism of Cm from the symplectic algebra which sends Ei onto Ei-i 
for every admissible i, except i = —m, and Tm{E-rn) = 0. In the case K = R we also 
assume that cr(Tm (e), e) > for all cq G Ei. 

By Remark 17. II we cannot the direct sum of (5sf with s € and , for example. The following 
theorem gives the classification of all degree —1 endomorphisms from the symplectic algebra of a 
graded symplectic space V and consequently the classification of all symbols of curves (both of 
unparametrized and parametrized) of symplectic flags of V with respect to Sp{V) and CSp{V): 

Theorem 7.2. Assume that V is a graded symplectic space. 

(1) // the grading on V is indexed by TL then a degree —1 endomorphism from spiV) is con- 
jugated (by a symplectic transformation) to the direct sum of endomorphisms of type S^^^^, 
where s is a nonnegative integer and < / < 2s. Moreover, for each pair of integers (s, /) 
with < / < 2s the number of appearances of S^J^^ in this direct sum is an invariant of the 
conjugate class. 

(2) If the grading on V is indexed by ^l^odd O'^d K = C, then a degree —1 endomorphism from 
5p{V) is conjugated (by a symplectic transformation) to the direct sum of endomorphisms 
of type d^J'i with s € ^"^odd o^'^d < / < 2s — 1, and of type Tm with positive m G ^Zodd- 
Moreover, for each pair (s, /) G ^Zodd x Z with < / < 2s — 1 and a positive m G ^Zodd the 
numbers of appearances of S^^.^ and Tm in this direct sum are invariants of the conjugate 
class. 

(3) // the grading on V is indexed by ^Zodd o,nd K = M, then a degree —1 endomorphism 
from 5p(V) is conjugated to the direct sum of endomorphisms of type Sf!^, Tm, and —Tm- 
Moreover, for each pair (s, /) G ^Zodd x Z with < I < 2s — 1 and a positive m G ^Zodd 
the numbers of appearances of S^^.^, t^, and —t^ in this direct sum are invariants of the 
conjugate class. 

Theorem 17.21 shows that, up to a conjugation, the only symplectically indecomposable endo- 
morphisms are the endomorphisms of the type d^J'i and Tm for K = C and of the type S^J'^, Tm, 

and —Tm in the case K = M. 

Proof. Let J be a degree —1 endomorphism of V belonging to 5p{V). Assume that 5'^^ = and 
(5' 7^ for some I > 0. Let C be a complement to kerd' in V, i.e. 

(7.3) y = Ceker5'. 
Define a bilinear form 6 : C x C i-^ K by 

(7.4) b{ui,U2) := (t{ui,5^U2). 

Since 6 G sp(y) and a is skew-symmetric, the form b is symmetric if I is odd and skew-symmetric 
if / is even. As a matter of fact the form b can be considered as a bilinear form on V/keidK 

Lemma 7.1. The form b is non- degenerate. 

Proof. Assume that there exists ui G C such that b{ui,U2) = for any U2 G C. In other words, 
a{ui,6''U2) = for any U2 G C. This together with splitting (|7.3p implies that a{ui,6^v) = for 
any v eV. Note that from the fact that 5 G sp{V) it follows that a{ui,6'-v) = (-l)'cr((5'ui, f ), 
therefore a{6''ui,v) = for any v Since a is non-degenerate, we get 6^ui = 0, i.e. ui G ker5^ 
As a consequence of this, our assumption that ui G C, and splitting ()7.3p we get that ui = 0. 
This completes the proof of the lemma. □ 
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Further from the sphtting (j7.3p it follows that 6^C D 5^C = for i > j. Set 

(7.5) Yi:=CeSC®...e6^C. 

Lemma 7.2. The restriction of the symplectic form a to the subspace Yi is non- degenerate. 

Proof. From Lemma l7.ll it follows that for any i the bilinear form {ui,U2) i— )• cj((5*ui, 5'~*M2) is 
non-degenerate. Also the condition d''^^ = implies that (j{6'^ui,6^U2) = for i + j > I. This 
implies that the matrix of the form cj|yj with respect to any basis of Yi is block-triangle with 
respect to non-principal diagonal and each non-principal diagonal block is nonsingular. This 
completes the proof of the lemma. □ 

We can always choose the space C in ()7.3p such that C is a direct sum of homogeneous spaces 
(i.e. a direct sum of subspaces of Vi). By the previous lemma, V = Yi (B 1^^, where 1^^ is the 
skew-symmetric complement of Yi . By constructions Y^^ C ker 5^ . Also it is easy to show that YJ"^ 
inherits the symplectic grading from V, Y^'^ = ^^^^ H Vi. Repeat the same procedure for 1^"^ 

instead of V, then, if necessary, repeat it again. In this way one gets the unique skew-orthogonal 
splitting of V into the direct sum of invariant subspaces of 6, 

d 

(7.6) V = ^Yi^, l = h>l2> ...>ld, 

i=l 

such that (^'*+^ |y, = 0, 6''^ \y, 7^ 0, 11, = Cj 5 Cj . . . for a complement to ker ly. in 
Yi., and each 1;, is a graded symplectic space with the grading inherited from V. 

From the splitting (|7.6p it follows that to prove our theorem it is sufficient to restrict ourself 
to the case when V = Yi, where Yi is as in (|7.5p . Assume that s is the maximal nontrivial degree 
in the grading of V (i.e Vs 7^ and Vi = foi i > s). Let be the space of all vectors of degree 
s in V. Then by constructions Zs is transversal to keiSK Let 

Af = <5Z^ . . . 6^Zs 

and Zs be the image of Zs in V/kev6'' under the canonical projection on the quotient space. In 
the sequel we will look on the form 6 as on a bilinear form on V/ ker 6^ . 

Lemma 7.3. The space X n X'^ is equal to or X . 

Proof. By the same arguments as in the proof of Lemma 17.21 the statement of the present lemma 
is equivalent to the following statement: the restriction of the form b on the space Zs is either 
equal to identically or non-degenerate. Set Ki = ker b\ ^ . Assume by contradiction that Ki is a 
nonzero proper subspace of Zs. Let {V^^^^ be the flag as in (j7.ip . From the assumption 

that Ki Zs it follows that 5Zs ^ {V'^+Y- Hence 

(7.7) ^ (y*"'+2)^. 

Since the flag {V^}j^z is symplectic, the space (1/'^^'+^)^ has to be equal to one of the subspaces 
of the flag {V^}j^z- This together with the assumption that s is the maximal degree in the 
grading of V and relation ()7.7p implies that 

(7.8) {V'-^+Y = Vs = Zs. 

Now let = {v e y/ker(5' : b{v,u) =0 \/u e Ki}. By constructions, Zs C K^. The 
assumption Ki 7^ implies that is a proper subspace of y/kerj'. Therefore there exist 
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elements of degree less than s in V that are transversal to kert^'. Consequently the space 
is a proper subspace of V and C ys-i+i xhis yields in turn that that is a 

nonzero proper subspace of (1/'^"'+^)^ = Vg, which contradicts the fact that the flag {V^}j(=.z is 
symplectic and that s is the maximal degree in the grading of V. The proof of the lemma is 
completed. □ 

Now consider separately the cases A" n = and X R = X . 
Lemma 7.4. If X<r\X^ = then V = X. 

Proof. V = X (B X^. Let us prove that X'^ = or, equivalently, V = X. Indeed, assume by 
contradiction that X^ ^ 0. Then X'^ is a graded symplectic spaces with the symplectic forms and 
the gradings inherited from V such that the maximal degree in the grading is less than s. This 
together with the assumption that V = Yi, where Yi is as in ()7.5p . implies that in the grading of 
V there are nonzero vectors of degree less than s — l + 1. This contradicts relation ()7.8p that must 
hold in the considered case. □ 

Lemma 7.5. Assume that X n X^ = 0. Then the following three statements hold: 

(1) /// is even, then the endomorphism 6 is conjugated to the direct sum of the endomorphisms 
Sf2s ^^^^ ^'^ integer s repeated ^ dim Zs times; 

(2) // / is odd and K = C, then the endomorphism 5 is conjugated to the direct sum of the 
endomorphisms rf repeated dim Zs times; 

(3) // I is odd and K = M, then the endomorphism S is conjugated to the direct sum of the 
endomorphisms t|'^ and — t|'^ such that the numbers of appearances of r^j^ and — ^'"s 
equal to the positive and the negative indices of the form b, respectively. 

Proof. In the considered case as a subspace C in (|7.3p one can take Zg . As was already mentioned 
before, the form b (defined on Zg) is non-degenerate symmetric if / is odd and non-degenerate 
skew-symmetric if / is even. If I is even we can choose a Darboux (symplectic) bases in Zg with 

— dim Z 

respect to the form b, i.e. a basis " such that the form b is nonzero (and equal to 

±1) only for the pairs {ej,Uj) and {vj,£j). Then for each 1 < j < ^dimZ^ the restriction of 
the endomorphism 5 to the minimal invariant subspaces of 5 containing £j and Vj is conjugated 
to 5^^.2g, which proves item (1) of the lemma. If I is odd we choose a basis of Zg for which the 
quadratic form corresponding to the form b is diagonal. Then for each vector of this basis the 
restriction of 5 to the minimal invariant subspaces of 5 containing this vector is conjugated to rf, 
which proves items (2) and (3) of the lemma. □ 



Now consider the case X n X'^ = X . In this case Zg C Z-^. The grading on V induces the 
natural grading on V/ ker 5^ . Take a subspace K2 consisting of the homogeneous elements of the 
minimal degree si in y/ker5'. By constructions si < s. Let us prove that 

(7.9) V/kevS^ = Z^ ®K2. 

Take a subspace K2 which is a representative of K2 in V and consists of homogeneous vectors (of 
degree si). Prom minimality of si it follows that V^j_i+i = 8^X2 and = for i > si — I + 1. 
From the maximality of s it follows that Zg = (y^i~'+2^^^ This implies that d\m.K2 = dimZ^ 
and that K2 H Z^ = 0, which in turn yields 



28 



Boris Doubrov and Igor Zelenko 



Now let y = K2 ® © ... © 5^X2- By constructions, the restriction of the endomorphism 5 to 
X ®y IS conjugated to the direct sum of endomorphisms 5^^.^ repeated dimZg times Further con- 
sider the space {X © yY. This space inherits the grading from V, {X © yY = ^{X ® yY n Vi, 

with the maximal nontrivial grading less than s. Repeat the same procedure for (^X ®yY instead 
of then, if necessary, repeat it again. In this way we decompose the endomorphism 5 in the 
case oiV = Yi to the direct sum of symbols of the type b^^.^ and Tm for K = C or (5^?"^, , and — 
in the case K = M. This together with the decomposition (|7.6p completes the proof of Theorem 
([7:2]) . □ 

Remark 7.2. In the works [4H H2] of the second author with C. Li parameterized curves in 
Lagrangian Grassmannian (over M) satisfying so-called condition (G) were considered. In the 
present terminology condition (G) of |4H W2\ is equivalent to the condition that the symbol of 
the parameterized curve of symplectic flag is conjugated to the direct sum of endomorphisms 
of type and — r^- The Young diagram which were assigned there to a curve in Lagrangian 
Grassmannian can be described as follows: for any p € N the number of rows of length p in it is 

equal to the number of appearances of endomorphisms Ta^.i and — Tj^.i in this direct sum. We 

2 2 

calculate the universal prolongation of such symbols in subsection 18.3.61 below, which together 
with Theorem 14.11 gives more conceptual point of view on the constructions of papers |4H W2\ and 
generalize them to more general classes of curves. 

7.3. Orthogonal case. The classification of symbols in this case is very similar to the symplectic 
case. As in the symplectic case we make a shift in the indices (either by an integer or by a 
half of an integer) such that (Aj)-*- = A-j+i for any i in Z or ^Zodd) where denotes the 
orthogonal complement of a subspace L with respect to the nondegenerate symmetric form Q. 
Further, by complete analogy with the symplectic space we can define graded orthogonal spaces 
and orthogonally indecomposable degree —1 endomorphisms. 

By analogy with (Dl) and (D2) of the previous subsection, there are the following two types 
of orthogonally indecomposable degree —1 endomomorphisms: 

(El) Given a positive s G |Z, and an integer I such that < / < 2(s -|- {s}) — 1 let be a a 
linear space equipped with a nondegenerate symmetric form and with a basis 

(7.10) {ds-h esj-s, • • • , fi-s} 

such that Q{ei,ej) = Q{fijj) = 0, cr{ei,fj) = (-l)"""*, if j = -i, and cr{ei,fj) = if 
j 7^ —i. Define the grading on V^.° such that the ith component equal to the span of 
all vectors with index i appearing in the tuple ()7.10p . It is an orthogonal grading. Then 
denote by (5^° a degree —1 endomorphism of V^.° from the symplectic algebra such that 
5f;(e,) = ei_'i ioi s-l + l<i<s, 5f;(e,_z) = 0, 5l"iifi) = for -s + 1 < z < Z - s, 
and 5-,(/_,) = 0. 

m 

(E2) Given a nonnegative integer m let = Ei be an orthogonal graded spaces such that 

i=—m 

dim Ei = 1 for every admissible i and let be a degree — 1 endomorphism of Cm from 
the symplectic algebra which sends Ei onto Ei-i for every admissible i, except i = —m, 
and T^{E-rn) = 0. In the case K = M we also assume that Q{Tm{e),e) > for all eo G Ei. 

The following theorem gives the classification of all degree — 1 endomorphisms from the orthog- 
onal algebra of a graded orthogonal space V and consequently the classification of all symbols of 
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curves (both of unparametrized and parametrized) of orthogonal flags of V with respect to 0{V) 
and CO{V): 

Theorem 7.3. Assume that V is a graded orthogonal space. 

(1) // the grading on V is indexed by ^Zodd then a degree —1 endomorphism from 5o{V) is 
conjugated (by an orthogonal transformation ) to the direct sum of endomorphisms of type 
5^°, where s G |Zodd andO < I < 2s. Moreover, for each pair of integers {s,l) € ^ZoddxZ 
with < / < 2s the number of appearances of in this direct sum is an invariant of the 
conjugate class. 

(2) // the grading on V is indexed by Z and K = C, then a degree —1 endomorphism from 
5o{V) is conjugated (by an orthonormal transformation) to the direct sum of endomor- 
phisms of type 5l°i with a positive integer s and < I < 2s — 1, and of type with a 
nonnegative integer m. Moreover, for each pair of integers {s,l) with < / < 2s — 1 a 
nonnegative integer m the numbers of appearances of (5^° and in this direct sum are 
invariants of the conjugate class. 

(3) // the grading on V is indexed by ^l^odd o-nd K = M, then a degree —1 endomorphism 
from 5o{V) is conjugated to the direct sum of endomorphisms of type 5^°i, t^, and —t^. 
Moreover, for each pair of integers (s, I) with < I < 2s — 1 and a nonnegarive integer m 
the numbers of appearances of dl°i, t^, and —t^ in this direct sum are invariants of the 
conjugate class. 

Theorem 17.31 shows that, up to a conjugation, the only orthogonally indecomposable endomor- 
phisms are the endomorphisms of the type (5^° and for K = C and of the type 5^° , r^, and 
— in the case K. = M. 

The proof of Theorem 17.31 is identical to the proof of Theorem 17.21 The only difference is that 
in the present case the form b, defined by (|7.4p . is symmetric if I is even and skew-symmetric if / 
is odd. Therefore Lemma 1731 should be modified appropriately. 

Remark 7.3. This remark is about a possible relation of the problem of classification of symbols 
to the theory of quiver representations ([21], [7]). In the case G = GL(W){ or SL(W)) there is an 
obvious one-to-one correspondence between the set of symbols (obtained in Theorem 17. 1|) and the 
set of indecomposable representations of the quivers with underlying indirect graph equal to the 
Dynkin diagram of type Ai (if one does not take into account possible shift in the range of indices 
in the graded space). It would be interesting to link the obtained classification of indecomposable 
symplectic and orthogonal symbols with representations of quivers with the corresponding Dynkin 
diagrams as underlying indirect graphs. □ 

8. Computation of algebraic prolongation of symbols for glassigal groups 

8.1. Decomposition of the universal prolongation algebra. First we point out some general 
properties of the universal algebraic prolongation in the case when g is a graded reductive Lie 
algebra. Let m be a line in q^i and u(m) be the universal algebraic prolongation of m, as defined 
in subsection 14.11 Take (5 G m. According to Jacobson-Morozov theorem \26\ Ch.III, Th. 17] 
(see also [39j for complex graded Lie algebras and [9j for real graded case), we can complete 5 by 
elements H and Y of degree and 1 respectively (in q) to the standard basis of a s[2-subalgebra 
of Q, i.e such that 

(8.1) [H, 6] = 26, [H, Y] = -2Y, [6, Y] = H. 

Let nmax(Tn) be the largest ideal in u(m) concentrated in the non-negative degree (i.e., nmax(n^) C 
^^■>gUj). Such ideal exists since the sum of any two ideals concentrated in the non-negative 
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de gree will also be an ideal of this type. It is also clear that ti-max 

(m) is graded, i.e. nmax(Tn) = 

Ei(i^max(m))., where (nmax(m)). 

On the one hand, since [5, nmax(Tn)] C nmax(Tn) and relations (|8.ip hold, we get that si2 H 
nmax(nv) = 0, which implies that 

(8.2) dimu(m)/nmax(nx) > 3. 

On the other hand, under the identification of the algebra u(m) with the algebra of infinitesimal 
symmetries of a flat curve with the symbol m (see subsection 14. ip . to any element of u(m) we 
can assign the vector field on the curve Fm- Consider the subspace nne(Tn) of u(m), consisting of 
all elements of u(m) for which the corresponding vector fields on F^ are identically zero. Clearly, 
nne(Tn) is an ideal of u(m). This ideal is called the non-effectiveness ideal o/u(m). Then the 
quotient algebra u(m)/nne(w) can be realized as a finite-dimensional Lie algebra of vector fields 
on a curve. From the classical Sophus Lie result it follows that 

(8.3) dimu(m)/n„e(^Ti) < 3 

(see the original proof in [27] , its translation and commentary in [6], and a self-contained proof in 
the recent paper [17J). Since nne(tn) C nmax(iTi) we get from ()8.2p and ()8.3p that nmax(Tn) = vine{vn) 
and that dimu(m)/nmax(iTi) = 3. The latter implies the following 

Proposition 8.1. u(m) is a semidirect sum of the constructed embedding o/s[2 into q andn^aaxi^) 
(= n„e(iTi) ). In particular, Umax is an s[2-module. 

The latter fact is very useful in the description of the universal algebraic prolongations of 
symbols of (unparametrized) curves of flags. 

Remark 8.1. For parametrized curves the corresponding universal prolongation of a symbol 
6 € 3-1 is equal to a semidirect sum of ]K(5 and the non-effectiveness ideal n^e- 

8.2. The case of G = GL{W) {SL{W)). We say that a graded space V which is also s[2-module 
is a nice 5i2-module, if the corresponding embedding of s[2 into 0l(I^) is spanned by endomorphisms 
of degree —1, 0, and 1. Let Vi and V2 be two nice 512-modules. Then Hom(Vi, V2) = V2<SiV{ is the 
5l2-module and a graded space in a natural way. Denote by n(Vi, V2) the maximal 5l2-submodule 
of Hom(Vi, V2) concentrated in the non-negative degree part. 

Assume that m = M5. By Theorem 17.11 there exists a map N : {{r,s) € Z x Z : r < s < 0} — >■ 
N U {00} with finite support such that 6 is conjugated to the endomorphism D]\i, which is the 
direct sum of indecomposable symbols where 6rs is repeated N{r, s) times. The endomorphism 
Dn acts on the space 

(8.4) Vrs^K^^''-'^. 

r<s<0 

First, Di\f can be extended to a subalgebra of QliVN) isomorphic to 5(2 which acts irreducibly on 
each Vrs- From ()8.4p it follows that 

01{Vn) = Vn^ {VnT = Hom(K,,,,y,2,J ^Hom(lC^(^'-i'^i),lC^('^2'^2)). 

ri < si < 0, 
r2 < S2 < 

Second, by definition of n(K.^si , V'r-jsj) we have that 

(8.5) p= n(y,,,,,y,,,,)$3Hom(]K^(^i'^i),K^('-2'^2)) 

ri < si < 0, 

^2 < S2 < 
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is the maximal 512-module in qI{Vn) concentrate in the non-negative degree part of qI{Vn)- Be- 
sides, p is a subalgebra of qI{Vn)- Indeed, [p,p] is an s[2-module in qI{Vn) concentrate in the 
non-negative degree, which imphes that [p,p] C p, because p is the maximal s[2-module satisfying 
this property. Therefore p = nniax(IKD„). 

It remains to describe n(V^^^s^, ^^2,52) more explicitly. Set li = Si — ri, i = 1,2. Note that 
sl2-submodule H-2S2 ® (^isj* is decomposed into the irreducible s[2-modules as follows: 

min{h,'2} 

(8.6) Rom{Vr,s,,Vr,s,) = Vr,s, {Vr,s,r = ^h+h~2i, 

where Ilj denotes an irreducible s[2-module of dimension j + 1 (see, for example, |20)). Moreover, 
the submodule H/^+^j of the largest dimension is generated by the elements of highest (or lowest) 
degree in K-jsa ^ (^risi)*, which is equal to S2 — ri (r2 — si respectively). The range of degrees 
for each next submodule in this decomposition is shrunk by 1 from both left and right sides, i.e. 
the submodule Ili^+i2-2i has degrees varying from r2 — si + i to S2 — ri — i. The submodule 
fi(K-isn K'2S2) is equal to the direct sum of submodules from the decomposition ()8.6p for which 
all degrees are non-negative. Therefore, 

mm{li,l2,S2—ri} 

(8.7) niVr,s„Vr2S2) = ^h+l2-2i. 

i=max{0,si— r2} 

In particular, 

(8.8) n(y„,y,,) ^no = Kid, 

(8.9) n(yrj^si,yr2S2) = if and only if S2 < si or r2 < ri. 

Let us prove statement (|8.9|) . Indeed by (|8.7|) n(K-^sj , 14-252) = if and only if one of the 
following three conditions holds: 

(1) si - r2 > si - ri = r2 < n; 

(2) si - r2 > S2 - r2 = S2 < si; 

(3) si - r2 > S2 - ri, 

which proves the "if" part of (jS.Op . Further, if conditions (1) and (2) does not hold then the 
condition (3) does not hold as well, which proves the "only if" part. 
Further, it is clear that 

(8.10) n(y,,,,, (g) K^\Vr2,s2 ® K^') = n(K,,,,, ^2,^2) ^ Hom^K^^^i'^i), K^^''^'^^)) . 
Combining ([83]), dHSl), dHj]), (|8lil . and Proposition [Owe get the following 

Theorem 8.1. The universal prolongation algebra u{M.Dn) of the symbol KD^v is equal to the 
semidirect sum of the constructed embedding of 5i2 into qI{V) and 

n(i;,,„K2S2) ® Hom(K^(^i'^i),lC^('^^'^^)), 

si < S2, ri < r2, 
rj < Sj < 

where n(14-^si , ^^252) as in ()8.7p . 

In particular, if 5 = 5rs then by ()8.8p one has nmax(<J) = IKId and u{5) = 3(2. This can be 
applied to Example 16.11 above. 

Remark 8.2. It is clear that in the case of G = SL{W) the universal prolongation of a symbol 
consists of the traceless part of the universal prolongation of the same symbol for G = GL{W). 
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8.3. The case of G = Sp{W) (CSp{W)) and G = 0{W) {CO{W)). First note that in the 
case G = GSp{W) {G = CO{W)) the universal algebraic prolongation of a symbol is equal to the 
direct sum of the universal algebraic prolongation of the same symbol for G = Sp{W) {G = 0{W)) 
with K. Therefore it is sufficient to concentrate on the case G = Sp{W) and G = 0{W). We 
will primary treat the symplectic case and briefly indicate what changes should be done for the 
orthogonal case. Let F be a graded symplectic space which is also a nice sl2-niodule such that 
the corresponding embedding of s[2 into 0[(^) belongs to sp(y) In this case we will say that V is 
a nice symplectic 5i2-module. The symplectic algebra 5p{V) is a s(2-module and a graded space 
in a natural way. Denote by the maximal s[2-submodule of sp(y) concentrated in the 

non- negative degree part. From the maximality assumption it follows that P'^(y) is a subalgebra 
of 5p{V). 

Further, assume that V = Li, where each Lj is a graded symplectic space and nice symplec- 

i=l 

tic s[2-modules (with all structures induced from V). The restriction o"|i. to Li of the symplectic 
form a of V defines natural identification between and its dual space L*. Here a denotes the 
symplectic form on V Consider the following splitting of 3l(T^): 

<? 

(8.11) B[(y) = Hom(L,,L,). 

An endomorphism A € 0f(T^), having the decomposition A = Yli j=i^ij with respect to the 
splitting ()8.1ip . belongs to 5p{V) if and only if An G sp(Lj) for all 1 < i < q and Aij = —A*^ 
for all 1 < i ^ j < q (here the dual linear map A*- is considered as a map from Li to Lj under 
the aforementioned identification Lj ~ L* and Lj ^ L'^). Therefore the map A i— )• ^ii + 

Si<i<j<g^«j defines the identification 

(8.12) sp J0L,J ^0sp(L,)e Hom(L,,L,). 

\i=l / i=l l<i<j<g 

Moreover, 

(8.13) [^P(0L,U0[^P(L,)© n(L„L,), 

\i=l / i=i l<i<j<q 

where n(Lj, Lj) is as in the previous subsection. 

Now take a symplectic symbol m = K6. Let V^^^ and Cf^. are graded symplectic spaces as in 
items (Dl) and (D2) of subsection [3l According to Theorem 17.21 (5 is conjugated to a direct sum 
of endomorphism of types S^^i, Tm, and , in the case of IK = M, also of type — • Therefore one 

q 

can always assume that V = ^^Li, where each Lj is either equal to 1/^^ or Cm. In the symplectic 

1=1 

/ 1 \ 

case the endomorphism 6 can be extended to a subalgebra of sp Lj isomorphic to s[2 such 

that if Lj = 1/^^ then T/f^ (with respect to the induced action) is the sum of two irreducible 
s[2-submodules 



^•14) Es-i = span{ej}s-/<j<s, Fs-i = span{/j}_ 



s<i<l~ 
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where and fi are as in (j7.10p . and if Li = Cm, then Cm (with respect to the induced action) 
is an irreducible s^-module. By analogy with the previous subsection the universal algebraic 
prolongation u(M(5) of the symbol M6 is equal to the semidirect sum of the constructed embedding 
o/s[2 into sp{V) and the algebra pf (0f=i-^^i)- 

The orthogonal case is treated in completely the same way. We only need to replace everywhere 
from the beginning of this subsection the word "symplectic" by the word " orthogonal" , the sign 
5p by the sign 50, and the symplectic form cr by a non-degenerate symmetric form Q. 

By identification ()8.13p and the analogous formula for the orthogonal case in order to compute 
P (0^=1 Li) (P" (0^=1 Li) and, consequently, the universal prolongation u{R6) in 5p{V) (so(F)) 
it is sufficient to compute spaces (F) (pP°(y)) and Hom(Vi, V2), where V, Vi, and V2 are equal 
either to Vj'^ or £^ (either to V;^° or £^). 

For this first denote by n(^r^^si),{r2,s2) righthand side of (j8.7p . 

min{li,l2,S2—ri} 

(8.15) Hri,s-^),{r2,S2) = ^ ^h+l2~2i, 

i=max{0,si — r2 } 

where li = Si — ri. 

8.3.1. Description o/[^P(F^'P) and \'°{V^°i). 

First let us give a convenient description of the algebras sp {v^^^ and so {Vs°i^ ■ In the sequel we 

will use the same notation for Eg-i and F^-i in the orthogonal case, as in (j8.14p . The symplectic form 
or the non-degenerate symmetric form define the following natural identifications: Eg-i = {Fg-i)* 
and Fg-i = (Eg-i)*. Keeping in mind these identifications, an endomorphism A E sl(l^), having 
decomposition A = An + A22 + A12 + A21 with respect to the splitting 

fl[(K;?) = QKEs;i) e qKF,,i) e Hom(F,;,, Es,i) e Hom(S,;,, Fs,i), 

belongs to 5p(v^^i^ if and only if Al^ = A12, ^21 = ^21, and A22 = -^n. It belongs to 5o(v^.fj 
if and only if AI2 = —A12, ^21 = —^21, and A22 = — Therefore the map A 1— )• A11+ A22 + A12 
defines the following identifications 

(8.16) spCl/^P) ^ Ql{E,.i) e S\E,.i) e S\F,.i), 

(8.17) so(K^?) ^ gl{E,.i) e S^E.-i) A^F^-i), 

where S'^{Es-i) and S'^{Fg.i) denote the symmetric square of Es-i and Fg-i, respectively, and A^{Es-i) 
and A'^{Fg.i) denote the skew-symmetric square of Eg-i and Fg-i- 

Here S'^^Eg-i) and a'^{Es-i) are subspaces of Hom(F<,.;, ^J^.;); S'^{Fs.i) and a'^{Fs.i) are subspaces 
of 'Rom{Es-i, Fg-i). Keeping this in mind, we define fj'.l {f°.l ) as the maximal s[2-submodule of 
S'^{Es-i) {a'^{Es-i)) concentrated in the non-negative degree part of S'^{Es-i) (A^(£'s;/))- Similarly, 
let [J^ {f°f) be the maximal s[2-submodule of ^^(F,.,) {A^{Es-i)). Then from (l8T6]) 

(8.18) f^{v:^,) - n(,_,,),(,_,,) e e - K e e 

(8.19) r (K^?) - n(,_,,),(,_,,,) e e - k e [-'^ e f^f 

Let us describe f^.i^ , f^.f 1^°/^ and 1^°'^. Let I = s — r. In order to describe t^.'j^ and t°.'j^ note 
that s[2-submodules S'^{Es-i) and f\^{Es-i)) are decomposed into the irreducible s[2-modules as 



34 



Boris Doubrov and Igor Zelenko 



follows: 

(8.20) S\E,.i) = ^U2i 



4i) 
1=0 



(8.21) A\Es.i) = ^2/_2-4^• 

1=0 

(see, for example, [20]). 

The submodule 112; of the largest dimension in S'^{Es-i) is generated by the elements of highest 
or lowest degree in S'^{Es-i), which are equal to 2s and 2s — 21, respectively. The range of degrees 
for each next submodule in the decomposition (|8.20p is shrunk by 2 from both left and right sides, 
i.e. the submodule Il2i-4i has degrees varying from 2s — 2/ + 2i and 2s — 2i. The submodule f^l 
is equal to the direct sum of the submodules from the decomposition (|8.20p for which all degrees 
are non-negative, i.e. for which max{0,/ — [s]} < i < min{[|], [s]}. Since / < 2[s], we have that 
[^] < [s\- Therefore 

(8-22) i;'= n2;_4„ 

i=max{0,i— [s]} 

Note that from the condition ^ < 2[s] and the last formula it follows that f^.j^ ^ 0. 
In order to get f^f we have to replace s by / — s in the righthand side of (|8.22|) . i.e. 

= n2,_4., 

i=max{0,i— [/—«]]} 

Again from the fact that I < 2[s] it follows that 

|-g p,2 ^ 1^ if ' is ^^^^ ™^ = |> 

1 otherwise. 

Besides, by (|8.8p one has n(s_/ (^.^ = IC. Substituting this and relation (|8.23p into (|8.22p we 
get that in the case / is odd or s 7^ | 

(8.24) i{v:i;)=K(Biif, 

where fj'.^^ is as in ()8.22p . Finally, by ()8.22p we get fp.2p = IK for any nonnegative integer p. From 
this, formula (j8.23p . and identification (|8.18p it is easy to see that for any nonnegative integer p 

(8.25) i'nv;^2p) = ^^2. 

Similarly in the orthogonal case the submodule n2/_2 of the largest dimension in a'^{Es-i) is 
generated by the elements of highest or lowest degree in A'^{Eg.i), which is equal to 2s — 1 and 
2s — 2/ + 1 respectively. The range of degrees for each next submodule in the decomposition 
(|8.2ip is shrunk by 2 from both left and right sides, i.e. the submodule 1^21-2-^1 has degrees 
varying from 2s — 2Z + 1 + 2i to 2s — 1 — 2i. The submodule f'^ is equal to the direct sum of 
submodules from the decomposition ()8.2ip for which all degrees are non-negative, i.e. for which 
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max{0,Z- [s+ i]} < i < min{[^], [s-^]}. Since / < 2(s + {s})-l, we have that [^] < [s- i]. 
Thus 

[¥] 

(8.26) i:°'^= U2l.2-4^, 

i=max{0,/-[s+|]]} 

Note that from the condition I < 2(s + {s}) — 1 and the last formula it follows that [^"^'^ 7^ 0. 
In order to get f°f we have to replace s by / — s in the righthand side of (j8.26|) . i.e. 

[¥] 

i=max{0,i-[i-s+i]} 

Again from the fact that I < 2(s + {s}) — 1 it follows that 



.27) r 



,50^2 j'^ ^ is odd and s = |, 



s:l 



otherwise. 



Similarly to (j8.24p in the case / is even or s 7^ 4 we get that 



2 

.28) r(F/.?) =ice[^°;\ 



where 1^°'^ is as in ()8.26p . Finally, by ()8.26p we get f^i^ _-, = ^ ^or any ^ G N. From this, 
formula (j8.27p . and identification (j8.19p it is easy to see that 

(8.29) i'°{V;\.^,^_,)=Bl2, pGN. 

8.3.2. Description of {'"^{Ct) and {Cf^) . 

Note that [''^{C'Jl) C n{£Z,Cm) = Kid, but Id ^ 5p{C'I). In the same way C 
n(£^,£f^) ^ Kid, but Id ^ so[c'^) Therefore 

(8.30) l''iC'^) = 0, l^"(O = 0. 

8.3.3. Description of niV:i^i^,V:i^iJ 0/ n(F/,V ' J^- 

By Remark 17.11 we are interested only in the cases when both si and S2 are integers or both si 
and S2 belong to |Zodd- Set ri = si — h and r2 = S2 — /2- In the sequel e will mean other sp or 
so. Note that 

Rom{Vl.i^,V,\.iJ = Hom(^;s,;,,,S,2;,2)eHom(Fs,;i,,F,2;/2)eHom(S,j;Z,,F,2;,2)eHom(F,,;/,,£;,2;,2). 
Therefore, 

(8.31) n(y/j.;^, V^j;;^ — ^{ri,si),{r2,S2) ® '^(-si,-ri),{-S2,-»'2) ® '^(r'l,si),(-S2,-»'2) ® "(-si,-ri),(r2,S2) 

Often many terms in the righthand side of (j8.3ip vanish. First, let us analyze the term iT(j,-|^ ^j^^ r2)' 
By ()8.9p if t^(ri,si),(-s2,-»'2) 7^ 0) then ri < — S2 and si < —r2 or, equivalently, si — li < —S2 and 
•si < ^2 — •52- In the symplectic case, in addition we have li < 2[si] and I2 < 2[s2]. Using all four 
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inequalities we get that si = S2, si,S2 are integers and h = I2 = 2si. This together with (j8.8 
impUes that 



.32) n(ri,si),(-S2,-r2) — ^{si-h,si),{-S2,l2-S2) 



K if Si = S2, Si, S2 € Z, h = I2 = 2si 
otherwise. 



In the orthogonal case, in addition to si — li < —S2 and si < /2 — •52 we have h < 2{si + {si}) — 1 
and I2 < 2(s2 + S2) — !]• Using all four inequalities we get that si = S2, si,S2 belongs to ^Zodd; 
and h = I2 = 2si. So, we will have the same formula as ()8.32p except that si, S2 belongs to ^Zodd- 
Further, by ^M) 



(8.33) n(_s^ _^j)^(_s2,-r2) = if and only if ri < r2 or si < S2- 

Substituting formulas (|8.32|) (or its analog for the orthogonal case), (|8.9p . (|8.33p into (|8.3ip and 
using (j8.15p for nonzero terms, one gets an explicit expression for t^(V'^^j'^.;^, V^'^.j^) . In particular, 
if (ri, si, r2, S2) (— s, s, —s, s), then at least two of the first three terms in the right handside of 
()8.3ip vanish. Finally, it is easy to see that 

(8.34) n{V,%.Vl;2s) = 9h, e = sp or so. 

8.3.4. Description of n{V'l,Ct) and of n{Vl°i , C^) ■ 
By analogy with the previous case 

(8-35) n{Vg.i,Cfn) = ^{s-l,s),{-m,m,) + (-m,m) 

First, let us analyze the term n(^g_i^s),{-m,m)- By ()8.9p if n(^s-i,s),{~m,m) 7^ 0) then s — I < —m 
and s < m. By Remark 17. 11 s € ^'^odd in the symplectic case and s € Z in the orthogonal case, 
and therefore Z < 2s — 1 in both cases, which together with the previous inequalities implies that 
— s + 1 < s — / < —m < — s, which is impossible. Consequently, for any admissible triple (/, s, m) 
we get n(s_/,s),{-m,m) = 0, i.e. 

(8.36) n{V,'.i,Cm) = n(^-s,i-s),(-m,m), £ = 50 or 5p. 

Besides, n(_5 /_5) 7^ if and only if / — s < m < s and it can be computed using formula 

8.3.5. Description of n{C^rii,J~-m2) (or of n{n^_^,C^^)). 
By (j8.9p . both for e = sp and e = so we have 



(8.37) n{£-^^, '^(— mi,nii),(— m2,m2) 



8.3.6. The case of tensor products. 



IC if mi = m2 
if mi 7^ 7712. 



In order to use formula (|8.13p more effectively it is worth also to say more about the space 
P''(y (g) K^), where F is a graded symplectic space which is also a nice symplectic s[2-module 
and V (8) IK^ inherits from V the structure of a graded symplectic space and of a nice symplectic 
s[2-module in a natural way. From (|8.12p it is easy to get the following natural identification: 



(8.38) 5p{V K^) ^ (sp(F) O K^) e (g[(F) ® aV), 
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where K^K^ denotes a skew-symmetric square of IC^. Consequently, 

(8.39) (g) K^) ^ ® K^) e (n(y) ® A^ET^). 

Combining (jS.lOp , ()8.39p , and the calculations of the subsections l8.3.Hl8r331 one can get more 
compact explicit formula for the algebraic prolongation of a given symplectic symbol. 
In particular, from ()8.30p and ()8.37p it follows that 

(8.40) [^P(£^ ® K^) ^ ^^K^ ^ 50{N). 

Now assume that K = 'R. Let y be a nice symplectic 512-module such that as a graded space 
it coincides with Cm ^ M^+^'^~ for some nonnegative integers A'^-i- and and the degree —1 
component of the corresponding embedding of 5l2 into 5p{V) is generated by the direct sum of 
Tm taken times and —Tm taken N- times. Then similarly to above it can be shown that 



(8.41) [(y) ^so(iV+,iV_). 

Further, fix two functions N^,N- : ^Zmod i-> N U {0} with finite support and assume that 
the symplectic symbol m is generated by the direct sum of endomorphisms of type Tm and —Tm, 
where Tm appears N^{m) times and —Tm appears A^_(m) times in this sum for each m E N. 
These symbols correspond to curves in a Lagrangian Grassmannian satisfying condition (G) in 
the terminology of the previous papers of the second author with C. Li (|4HI42|). Then from (j8.4ip 
and ()8.37p it follows that the non-effectiveness ideal of u(m) is equal to so(A^+(m), A^_(m)) 

meN 

and it is concentrated in the zero component of u(m). From this and Remark 18. II it follows that in 
the parameterized case u+(m) = 5o(A^-4-(m), A^_(m)) and, by Theorem 14. II and Remark 14.31 if 

meN 

the normalization condition is fixed, then for any parametrized curve of fiags with symbol m there 
exists a unique principle bundle of moving frames with the structure group Jj0(iV+(m),iV_(m)) 

m<=N 

and the unique principle Ehresmann connection such that this connection satisfies the chosen 
normalization condition. This result was proved in |4H [32] ( Theorem 1 in [3T] and Theorems 1 
and 3 in [42j) for specifically chosen normalization conditions. So, our main Theorem 14.11 gives 
more conceptual point of view on the constructions of those papers and clarifies them algebraically. 

Finally, formulas (|8.39p - (|8.4ip hold true if F is a graded orthogonal space and sp is replaced by 
50. Also, the same conclusion as in the previous paragraph can be done if an orthogonal symbol 
is generated by the direct sum of endomorphisms of type t^ and — 
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